[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:43 dist-test-slave-zj8q krb5kdc[26733](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:43 dist-test-slave-zj8q krb5kdc[26733](info): set up 2 sockets
Aug 08 07:01:43 dist-test-slave-zj8q krb5kdc[26733](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 07:01:44.544473 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:01:44 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:01:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:01:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:01:44.656939 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39155
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:44.737247 26751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:44.737440 26751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:44.737461 26751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:44.738616 26751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:01:44.738656 26751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:44.738669 26751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:44.738680 26751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:01:44.738705 26751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:01:44.740165 26751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:44.740370 26751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:44.740653 26751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:44.745571 26765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:44.745673 26751 server_base.cc:1034] running on GCE node
W20260808 07:01:44.745570 26769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:44.745622 26764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:44.746047 26751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:44.746345 26751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:44.747500 26751 hybrid_clock.cc:648] HybridClock initialized: now 1786172504747523 us; error 71 us; skew 500 ppm
Aug 08 07:01:44 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172504, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:44.749866 26751 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:01:44.750325 26751 webserver.cc:460] Webserver started at http://127.26.23.190:33903/ using document root <none> and password file <none>
I20260808 07:01:44.750552 26751 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:44.750602 26751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:44.750725 26751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:44.751775 26751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "5429ba8366854259be019ea2271db294"
format_stamp: "Formatted at 2026-08-08 07:01:44 on dist-test-slave-zj8q"
server_key: "1b493cfb93f710602eb35f4d165a047a"
server_key_iv: "cba705e249bfa3fb1a86208fdfc3d00e"
server_key_version: "encryptionkey@0"
I20260808 07:01:44.752123 26751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "5429ba8366854259be019ea2271db294"
format_stamp: "Formatted at 2026-08-08 07:01:44 on dist-test-slave-zj8q"
server_key: "1b493cfb93f710602eb35f4d165a047a"
server_key_iv: "cba705e249bfa3fb1a86208fdfc3d00e"
server_key_version: "encryptionkey@0"
I20260808 07:01:44.753342 26751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:01:44.754020 26782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:44.754199 26751 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:44.754295 26751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "5429ba8366854259be019ea2271db294"
format_stamp: "Formatted at 2026-08-08 07:01:44 on dist-test-slave-zj8q"
server_key: "1b493cfb93f710602eb35f4d165a047a"
server_key_iv: "cba705e249bfa3fb1a86208fdfc3d00e"
server_key_version: "encryptionkey@0"
I20260808 07:01:44.754364 26751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:44.783790 26751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:44.785621 26751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:44.785753 26751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:44.789675 26751 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39155
I20260808 07:01:44.789726 26870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39155 every 8 connection(s)
I20260808 07:01:44.790055 26751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:01:44.790938 26872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:44.791579 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 26751
I20260808 07:01:44.791666 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:01:44.792266 26718 external_mini_cluster.cc:1428] Setting key 316316d1b9dd3a4a049975673c702e50
I20260808 07:01:44.793406 26872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294: Bootstrap starting.
I20260808 07:01:44.794114 26872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:44.794462 26872 log.cc:824] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:44.795228 26872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294: No bootstrap required, opened a new log
I20260808 07:01:44.797562 26872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5429ba8366854259be019ea2271db294" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39155 } }
I20260808 07:01:44.797735 26872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:44.797773 26872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5429ba8366854259be019ea2271db294, State: Initialized, Role: FOLLOWER
I20260808 07:01:44.797902 26872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5429ba8366854259be019ea2271db294" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39155 } }
I20260808 07:01:44.797986 26872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:01:44.798032 26872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:01:44.798079 26872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:44.799158 26872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5429ba8366854259be019ea2271db294" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39155 } }
I20260808 07:01:44.799252 26872 leader_election.cc:302] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5429ba8366854259be019ea2271db294; no voters:
I20260808 07:01:44.799432 26872 leader_election.cc:288] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:01:44.799485 26878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:44.799633 26878 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [term 1 LEADER]: Becoming Leader. State: Replica: 5429ba8366854259be019ea2271db294, State: Running, Role: LEADER
I20260808 07:01:44.799690 26872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:01:44.799726 26878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5429ba8366854259be019ea2271db294" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39155 } }
I20260808 07:01:44.800153 26880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5429ba8366854259be019ea2271db294. Latest consensus state: current_term: 1 leader_uuid: "5429ba8366854259be019ea2271db294" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5429ba8366854259be019ea2271db294" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39155 } } }
I20260808 07:01:44.800235 26880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:44.800370 26879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5429ba8366854259be019ea2271db294" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5429ba8366854259be019ea2271db294" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39155 } } }
I20260808 07:01:44.800426 26879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294 [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:44.800559 26886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:01:44.801019 26886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:01:44.803403 26886 catalog_manager.cc:1347] Generated new cluster ID: 31adcb9386004feba7ba6144aba754b8
I20260808 07:01:44.803457 26886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:01:44 dist-test-slave-zj8q krb5kdc[26733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:44.810546 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:44.793206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47146 (local address 127.26.23.190:39155)
0808 07:01:44.793476 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:44.793486 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:44.793593 (+ 107us) server_negotiation.cc:407] Connection header received
0808 07:01:44.796520 (+ 2927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:44.796534 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:44.796580 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:44.796684 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:44.799034 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:44.800416 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:44.801902 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:44.802510 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:44.802628 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:44.806791 (+ 4163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:44.806795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:44.806795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:44.806806 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:44.808628 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:44.809126 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:44.809128 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:44.809129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:44.809222 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:44.809489 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:44.809490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:44.809490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:44.809753 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:44.809907 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:44.810214 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 07:01:44.810343 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":81,"threads_started":1}
I20260808 07:01:44.813228 26886 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:01:44.813709 26886 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:01:44.820132 26886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5429ba8366854259be019ea2271db294: Generated new TSK 0
I20260808 07:01:44.820278 26886 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:01:44.847119 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39155
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:44.959256 26914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:44.959460 26914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:44.959484 26914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:44.960649 26914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:44.960691 26914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:44.960718 26914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:01:44.962329 26914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39155
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:44.962556 26914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:44.962766 26914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:44.968621 26924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:44.968797 26923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:44.968811 26926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:44.969066 26914 server_base.cc:1034] running on GCE node
I20260808 07:01:44.969236 26914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:44.969456 26914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:44.970602 26914 hybrid_clock.cc:648] HybridClock initialized: now 1786172504970609 us; error 52 us; skew 500 ppm
Aug 08 07:01:44 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172504, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:44.973699 26914 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:01:44.974090 26914 webserver.cc:460] Webserver started at http://127.26.23.129:43433/ using document root <none> and password file <none>
I20260808 07:01:44.974303 26914 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:44.974352 26914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:44.974478 26914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:44.975626 26914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "bae604533f0243a0936303f17cfe700d"
format_stamp: "Formatted at 2026-08-08 07:01:44 on dist-test-slave-zj8q"
server_key: "a9cf1baed3e6cc235bcacb548e4e52b2"
server_key_iv: "26a74171fbe8f12a9ce18cefb8a8f7ec"
server_key_version: "encryptionkey@0"
I20260808 07:01:44.976004 26914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "bae604533f0243a0936303f17cfe700d"
format_stamp: "Formatted at 2026-08-08 07:01:44 on dist-test-slave-zj8q"
server_key: "a9cf1baed3e6cc235bcacb548e4e52b2"
server_key_iv: "26a74171fbe8f12a9ce18cefb8a8f7ec"
server_key_version: "encryptionkey@0"
I20260808 07:01:44.977492 26914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:01:44.978292 26934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:44.978447 26914 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:44.978572 26914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "bae604533f0243a0936303f17cfe700d"
format_stamp: "Formatted at 2026-08-08 07:01:44 on dist-test-slave-zj8q"
server_key: "a9cf1baed3e6cc235bcacb548e4e52b2"
server_key_iv: "26a74171fbe8f12a9ce18cefb8a8f7ec"
server_key_version: "encryptionkey@0"
I20260808 07:01:44.978637 26914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:44.986593 26914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:44.988885 26914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:44.989078 26914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:44.989388 26914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:44.989773 26914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:44.989817 26914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:44.989851 26914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:44.989872 26914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.003881 26914 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:33615
I20260808 07:01:45.004053 27118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:33615 every 8 connection(s)
I20260808 07:01:45.004227 26914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172504, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:45.012005 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 26914
I20260808 07:01:45.012110 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:01:45.012251 26718 external_mini_cluster.cc:1428] Setting key 83e53184f9cce60971e0e17ea4647898
I20260808 07:01:45.013494 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.004869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:58819 (local address 127.26.23.190:39155)
0808 07:01:45.004945 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:45.004948 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:45.005186 (+ 238us) server_negotiation.cc:407] Connection header received
0808 07:01:45.005735 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:45.005736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:45.005746 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:45.005795 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:45.006744 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.007257 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.008250 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.008433 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.008475 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.010726 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:45.010728 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:45.010728 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:45.010736 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:45.012083 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.012550 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.012552 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.012552 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.012627 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.012896 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.012897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.012897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.013007 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:45.013055 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:45.013359 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 07:01:45.013429 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:01:45.013751 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.004852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39155 (local address 127.26.23.129:58819)
0808 07:01:45.005065 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:45.005100 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:45.005657 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:45.005849 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:45.005852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:45.006442 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:45.006672 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:45.006678 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.007334 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.007335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:45.008186 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:45.008190 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.008597 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.008599 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:45.008732 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.009152 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:45.009159 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:45.010636 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:45.012193 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:45.012200 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:45.012202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:45.012467 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:45.012716 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:45.012717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:45.012717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:45.012832 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:45.013069 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:45.013076 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:45.013239 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 07:01:45.013348 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 07:01:45.013506 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":115,"threads_started":1}
I20260808 07:01:45.014272 27122 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39155
I20260808 07:01:45.014366 27122 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:45.014535 27122 heartbeater.cc:511] Master 127.26.23.190:39155 requested a full tablet report, sending...
I20260808 07:01:45.015017 26811 ts_manager.cc:194] Registered new tserver with Master: bae604533f0243a0936303f17cfe700d (127.26.23.129:33615)
I20260808 07:01:45.015585 26811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:58819
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:01:45.037065 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39155
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:45.137259 27129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:45.137447 27129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:45.137468 27129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:45.138562 27129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:45.138595 27129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:45.138619 27129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:01:45.139997 27129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39155
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:45.140177 27129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:45.140362 27129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:45.145367 27140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:45.145435 27136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:45.145533 27129 server_base.cc:1034] running on GCE node
W20260808 07:01:45.145378 27137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:45.145785 27129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:45.146006 27129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:45.147140 27129 hybrid_clock.cc:648] HybridClock initialized: now 1786172505147132 us; error 48 us; skew 500 ppm
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:45.149542 27129 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:01:45.149979 27129 webserver.cc:460] Webserver started at http://127.26.23.130:40305/ using document root <none> and password file <none>
I20260808 07:01:45.150221 27129 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:45.150274 27129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:45.150394 27129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:45.151400 27129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "414acc9377a147958eecd56c96cea27b"
format_stamp: "Formatted at 2026-08-08 07:01:45 on dist-test-slave-zj8q"
server_key: "8e792d01439cd41a804b3b8878ee5c42"
server_key_iv: "8f6324c8473b3bdb4a58ed8804b7bd5c"
server_key_version: "encryptionkey@0"
I20260808 07:01:45.151736 27129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "414acc9377a147958eecd56c96cea27b"
format_stamp: "Formatted at 2026-08-08 07:01:45 on dist-test-slave-zj8q"
server_key: "8e792d01439cd41a804b3b8878ee5c42"
server_key_iv: "8f6324c8473b3bdb4a58ed8804b7bd5c"
server_key_version: "encryptionkey@0"
I20260808 07:01:45.152978 27129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:01:45.153646 27151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.153788 27129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:45.153874 27129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "414acc9377a147958eecd56c96cea27b"
format_stamp: "Formatted at 2026-08-08 07:01:45 on dist-test-slave-zj8q"
server_key: "8e792d01439cd41a804b3b8878ee5c42"
server_key_iv: "8f6324c8473b3bdb4a58ed8804b7bd5c"
server_key_version: "encryptionkey@0"
I20260808 07:01:45.153934 27129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:45.168504 27129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:45.170292 27129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:45.170429 27129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:45.170642 27129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:45.170944 27129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:45.170979 27129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.171006 27129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:45.171025 27129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.176918 27129 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:39143
I20260808 07:01:45.176957 27333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:39143 every 8 connection(s)
I20260808 07:01:45.177261 27129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:01:45.182240 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27129
I20260808 07:01:45.182322 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:01:45.182477 26718 external_mini_cluster.cc:1428] Setting key a453072b69b6fe30aa6111a252c47668
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:45.186224 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.177942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:42853 (local address 127.26.23.190:39155)
0808 07:01:45.177987 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:45.177989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:45.178202 (+ 213us) server_negotiation.cc:407] Connection header received
0808 07:01:45.178676 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:45.178677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:45.178688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:45.178737 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:45.179633 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.180151 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.181157 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.181375 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.181427 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.183592 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:45.183593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:45.183594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:45.183600 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:45.184869 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.185251 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.185253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.185253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.185313 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.185554 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.185555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.185556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.185666 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:45.185722 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:45.186037 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 07:01:45.186111 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:01:45.186389 27340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.177910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39155 (local address 127.26.23.130:42853)
0808 07:01:45.178082 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:45.178117 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:45.178582 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:45.178800 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:45.178803 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:45.179339 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:45.179528 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:45.179533 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.180242 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.180243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:45.181074 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:45.181076 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.181436 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.181437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:45.181544 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.181957 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:45.181965 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:45.183501 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:45.184947 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:45.184955 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:45.184957 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:45.185182 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:45.185375 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:45.185376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:45.185376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:45.185482 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:45.185720 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:45.185727 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:45.185885 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 07:01:45.185990 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 07:01:45.186180 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":114,"threads_started":1}
I20260808 07:01:45.186800 27337 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39155
I20260808 07:01:45.186885 27337 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:45.187049 27337 heartbeater.cc:511] Master 127.26.23.190:39155 requested a full tablet report, sending...
I20260808 07:01:45.187429 26811 ts_manager.cc:194] Registered new tserver with Master: 414acc9377a147958eecd56c96cea27b (127.26.23.130:39143)
I20260808 07:01:45.187913 26811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:42853
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:01:45.208462 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39155
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:45.289750 27345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:45.289947 27345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:45.289978 27345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:45.291335 27345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:45.291392 27345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:45.291424 27345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:01:45.293027 27345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39155
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:45.293218 27345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:45.293387 27345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:45.298197 27357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:45.298254 27352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:45.298266 27351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:45.298296 27345 server_base.cc:1034] running on GCE node
I20260808 07:01:45.298568 27345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:45.298763 27345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:45.299897 27345 hybrid_clock.cc:648] HybridClock initialized: now 1786172505299878 us; error 32 us; skew 500 ppm
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:45.302423 27345 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:01:45.302816 27345 webserver.cc:460] Webserver started at http://127.26.23.131:32961/ using document root <none> and password file <none>
I20260808 07:01:45.302996 27345 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:45.303033 27345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:45.303115 27345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:45.304049 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "b96fa1b1b53e49c1a4a6f963c7c9c741"
format_stamp: "Formatted at 2026-08-08 07:01:45 on dist-test-slave-zj8q"
server_key: "ef0aeb43fd97f80b145a34a6f6001577"
server_key_iv: "c93a01162d77508759308c700bd60964"
server_key_version: "encryptionkey@0"
I20260808 07:01:45.304345 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "b96fa1b1b53e49c1a4a6f963c7c9c741"
format_stamp: "Formatted at 2026-08-08 07:01:45 on dist-test-slave-zj8q"
server_key: "ef0aeb43fd97f80b145a34a6f6001577"
server_key_iv: "c93a01162d77508759308c700bd60964"
server_key_version: "encryptionkey@0"
I20260808 07:01:45.305507 27345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:01:45.306190 27373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.306348 27345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.306434 27345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "b96fa1b1b53e49c1a4a6f963c7c9c741"
format_stamp: "Formatted at 2026-08-08 07:01:45 on dist-test-slave-zj8q"
server_key: "ef0aeb43fd97f80b145a34a6f6001577"
server_key_iv: "c93a01162d77508759308c700bd60964"
server_key_version: "encryptionkey@0"
I20260808 07:01:45.306501 27345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:45.318289 27345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:45.319921 27345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:45.320058 27345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:45.320289 27345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:45.320567 27345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:45.320601 27345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.320628 27345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:45.320645 27345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:45.326213 27345 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:35995
I20260808 07:01:45.326269 27545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:35995 every 8 connection(s)
I20260808 07:01:45.326541 27345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:45.333197 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27345
I20260808 07:01:45.333263 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:01:45.333405 26718 external_mini_cluster.cc:1428] Setting key c520c169d7bdd2213e701e8cdc2a3f5d
I20260808 07:01:45.335281 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.327272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:57707 (local address 127.26.23.190:39155)
0808 07:01:45.327343 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:45.327345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:45.327486 (+ 141us) server_negotiation.cc:407] Connection header received
0808 07:01:45.327990 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:45.327992 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:45.328005 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:45.328053 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:45.328989 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.329492 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.330485 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.330687 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.330742 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.332663 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:45.332665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:45.332665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:45.332672 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:45.334063 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.334507 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.334508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.334509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.334567 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.334797 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.334798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.334798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.334896 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:45.334942 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:45.335125 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 07:01:45.335214 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:01:45.335397 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.327200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39155 (local address 127.26.23.131:57707)
0808 07:01:45.327367 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:45.327411 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:45.327894 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:45.328133 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:45.328161 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:45.328712 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:45.328895 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:45.328900 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.329577 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.329578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:45.330408 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:45.330411 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.330755 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.330756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:45.330867 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.331279 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:45.331287 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:45.332563 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:45.334135 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:45.334141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:45.334143 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:45.334417 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:45.334643 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:45.334643 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:45.334644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:45.334750 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:45.334937 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:45.334940 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:45.335042 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 07:01:45.335113 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:01:45.335229 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260808 07:01:45.335814 27548 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39155
I20260808 07:01:45.335898 27548 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:45.336061 27548 heartbeater.cc:511] Master 127.26.23.190:39155 requested a full tablet report, sending...
I20260808 07:01:45.336381 26811 ts_manager.cc:194] Registered new tserver with Master: b96fa1b1b53e49c1a4a6f963c7c9c741 (127.26.23.131:35995)
I20260808 07:01:45.336736 26811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:57707
I20260808 07:01:45.345297 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:01:45.367723 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.360793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32830 (local address 127.26.23.129:33615)
0808 07:01:45.360939 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:45.360944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:45.360955 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:01:45.360991 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:45.360993 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:45.361006 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:45.361073 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:45.361582 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.362340 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.363007 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.363316 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.363370 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.365325 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:45.365332 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:45.365333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:45.365339 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:45.366794 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.367086 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.367089 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.367089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.367156 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.367282 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.367282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.367282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.367394 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:45.367484 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:45.367579 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 07:01:45.367641 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
W20260808 07:01:45.368047 26982 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32830
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[26733](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:01:45.388906 27566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:45.382610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32844 (local address 127.26.23.129:33615)
0808 07:01:45.382670 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:45.382672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:45.382771 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:01:45.382834 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:45.382835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:45.382845 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:45.382890 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:45.383430 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.383915 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.384646 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:45.384848 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:45.384903 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:45.386887 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:45.386889 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:45.386889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:45.386898 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:45.387904 (+ 1006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.388195 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.388196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.388196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.388245 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:45.388403 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:45.388404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:45.388404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:45.388493 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:45.388658 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:45.388734 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 07:01:45.388813 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:01:45.389364 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 26914
I20260808 07:01:45.401611 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27129
I20260808 07:01:45.407359 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27345
I20260808 07:01:45.425258 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 26751
2026-08-08T07:01:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2080 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[27580](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[27580](info): set up 2 sockets
Aug 08 07:01:45 dist-test-slave-zj8q krb5kdc[27580](info): commencing operation
krb5kdc: starting...
W20260808 07:01:46.566344 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:01:46 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:01:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:01:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:01:46.688732 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:35699
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:35699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:46.769188 27603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:46.769387 27603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:46.769418 27603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:46.770545 27603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:01:46.770584 27603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:46.770610 27603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:46.770627 27603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:01:46.770644 27603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:01:46.772106 27603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:35699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:35699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:46.772339 27603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:46.772533 27603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:46.777236 27609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:46.777204 27611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:46.777282 27603 server_base.cc:1034] running on GCE node
W20260808 07:01:46.777186 27613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:46.777647 27603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:46.777916 27603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:46.779078 27603 hybrid_clock.cc:648] HybridClock initialized: now 1786172506779051 us; error 37 us; skew 500 ppm
Aug 08 07:01:46 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172506, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:46.781440 27603 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:01:46.781862 27603 webserver.cc:460] Webserver started at http://127.26.23.190:36435/ using document root <none> and password file <none>
I20260808 07:01:46.782060 27603 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:46.782115 27603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:46.782259 27603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:46.783272 27603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "a098af7c18ac445bae551e2fc413eff5"
format_stamp: "Formatted at 2026-08-08 07:01:46 on dist-test-slave-zj8q"
server_key: "24d0d63b83c401ac5f23161718dccc88"
server_key_iv: "5f5b011dd250354e8e87c16e5796b38e"
server_key_version: "encryptionkey@0"
I20260808 07:01:46.783597 27603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "a098af7c18ac445bae551e2fc413eff5"
format_stamp: "Formatted at 2026-08-08 07:01:46 on dist-test-slave-zj8q"
server_key: "24d0d63b83c401ac5f23161718dccc88"
server_key_iv: "5f5b011dd250354e8e87c16e5796b38e"
server_key_version: "encryptionkey@0"
I20260808 07:01:46.784816 27603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:01:46.785491 27620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:46.785679 27603 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:46.785766 27603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "a098af7c18ac445bae551e2fc413eff5"
format_stamp: "Formatted at 2026-08-08 07:01:46 on dist-test-slave-zj8q"
server_key: "24d0d63b83c401ac5f23161718dccc88"
server_key_iv: "5f5b011dd250354e8e87c16e5796b38e"
server_key_version: "encryptionkey@0"
I20260808 07:01:46.785825 27603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:46.802248 27603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:46.804239 27603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:46.804373 27603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:46.808295 27603 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:35699
I20260808 07:01:46.808344 27701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:35699 every 8 connection(s)
I20260808 07:01:46.808665 27603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:01:46.809507 27702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:46.811839 27702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5: Bootstrap starting.
I20260808 07:01:46.812436 27702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:46.812718 27702 log.cc:824] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:46.813369 27702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5: No bootstrap required, opened a new log
I20260808 07:01:46.813407 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27603
I20260808 07:01:46.813490 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:01:46.813670 26718 external_mini_cluster.cc:1428] Setting key 0efafc11a9ee2b8675093c3d32f6e6a2
I20260808 07:01:46.815444 27702 raft_consensus.cc:348] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a098af7c18ac445bae551e2fc413eff5" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35699 } }
I20260808 07:01:46.815629 27702 raft_consensus.cc:374] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:46.815685 27702 raft_consensus.cc:729] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a098af7c18ac445bae551e2fc413eff5, State: Initialized, Role: FOLLOWER
I20260808 07:01:46.815804 27702 consensus_queue.cc:260] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a098af7c18ac445bae551e2fc413eff5" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35699 } }
I20260808 07:01:46.815892 27702 raft_consensus.cc:388] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:01:46.815917 27702 raft_consensus.cc:482] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:01:46.815961 27702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:46.817013 27702 raft_consensus.cc:504] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a098af7c18ac445bae551e2fc413eff5" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35699 } }
I20260808 07:01:46.817122 27702 leader_election.cc:302] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a098af7c18ac445bae551e2fc413eff5; no voters:
I20260808 07:01:46.817272 27702 leader_election.cc:288] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:01:46.817314 27710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:46.817447 27710 raft_consensus.cc:686] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [term 1 LEADER]: Becoming Leader. State: Replica: a098af7c18ac445bae551e2fc413eff5, State: Running, Role: LEADER
I20260808 07:01:46.817497 27702 sys_catalog.cc:564] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:01:46.817538 27710 consensus_queue.cc:237] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a098af7c18ac445bae551e2fc413eff5" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35699 } }
I20260808 07:01:46.817971 27711 sys_catalog.cc:455] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a098af7c18ac445bae551e2fc413eff5. Latest consensus state: current_term: 1 leader_uuid: "a098af7c18ac445bae551e2fc413eff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a098af7c18ac445bae551e2fc413eff5" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35699 } } }
I20260808 07:01:46.818063 27711 sys_catalog.cc:458] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:46.818298 27723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:01:46.818776 27723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:01:46.818876 27712 sys_catalog.cc:455] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a098af7c18ac445bae551e2fc413eff5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a098af7c18ac445bae551e2fc413eff5" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35699 } } }
I20260808 07:01:46.818970 27712 sys_catalog.cc:458] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5 [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:46.821360 27723 catalog_manager.cc:1347] Generated new cluster ID: 855a13aec46a43dda8cad7e4005e9ba5
I20260808 07:01:46.821414 27723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:01:46 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:46.825163 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:46.814191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.26.23.190:35699)
0808 07:01:46.814394 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:46.814403 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:46.814437 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:01:46.815405 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:46.815414 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:46.815481 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:46.815628 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:46.816283 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:46.817681 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:46.818743 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:46.819344 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:46.819445 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:46.822106 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:46.822110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:46.822110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:46.822122 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:46.823709 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:46.824047 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:46.824051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:46.824051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:46.824178 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:46.824361 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:46.824362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:46.824362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:46.824608 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:46.824752 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:46.824861 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 07:01:46.824996 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":89,"threads_started":1}
I20260808 07:01:46.833992 27723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:01:46.834555 27723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:01:46.841382 27723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a098af7c18ac445bae551e2fc413eff5: Generated new TSK 0
I20260808 07:01:46.841558 27723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:01:46.873610 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:35699
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:46.954298 27745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:46.954493 27745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:46.954516 27745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:46.955602 27745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:46.955634 27745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:46.955659 27745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:01:46.957135 27745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:35699
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:46.957342 27745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:46.957526 27745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:46.962532 27751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:46.962551 27752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:46.962550 27754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:46.962584 27745 server_base.cc:1034] running on GCE node
I20260808 07:01:46.962972 27745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:46.963204 27745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:46.964350 27745 hybrid_clock.cc:648] HybridClock initialized: now 1786172506964338 us; error 31 us; skew 500 ppm
Aug 08 07:01:46 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172506, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:46.966755 27745 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:01:46.967167 27745 webserver.cc:460] Webserver started at http://127.26.23.129:40421/ using document root <none> and password file <none>
I20260808 07:01:46.967360 27745 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:46.967407 27745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:46.967530 27745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:46.968552 27745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "fd87448a0c05451f8e91d723f43bcb80"
format_stamp: "Formatted at 2026-08-08 07:01:46 on dist-test-slave-zj8q"
server_key: "78a6f2a28680ff384af02d7118218bf9"
server_key_iv: "0c0de334c2750cb45bc367cad3c00725"
server_key_version: "encryptionkey@0"
I20260808 07:01:46.968878 27745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "fd87448a0c05451f8e91d723f43bcb80"
format_stamp: "Formatted at 2026-08-08 07:01:46 on dist-test-slave-zj8q"
server_key: "78a6f2a28680ff384af02d7118218bf9"
server_key_iv: "0c0de334c2750cb45bc367cad3c00725"
server_key_version: "encryptionkey@0"
I20260808 07:01:46.970144 27745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:01:46.970829 27766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:46.970983 27745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:46.971067 27745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "fd87448a0c05451f8e91d723f43bcb80"
format_stamp: "Formatted at 2026-08-08 07:01:46 on dist-test-slave-zj8q"
server_key: "78a6f2a28680ff384af02d7118218bf9"
server_key_iv: "0c0de334c2750cb45bc367cad3c00725"
server_key_version: "encryptionkey@0"
I20260808 07:01:46.971153 27745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:46.994053 27745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:46.995982 27745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:46.996124 27745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:46.996330 27745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:46.996629 27745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:46.996670 27745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:46.996699 27745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:46.996722 27745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.002417 27745 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:45363
I20260808 07:01:47.002480 27965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:45363 every 8 connection(s)
I20260808 07:01:47.002760 27745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:01:47.008419 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27745
I20260808 07:01:47.008515 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:01:47.008678 26718 external_mini_cluster.cc:1428] Setting key 528cd888acaad51260da075b320ba1d3
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172506, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:47.011968 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.003405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:42333 (local address 127.26.23.190:35699)
0808 07:01:47.003458 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.003461 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.003665 (+ 204us) server_negotiation.cc:407] Connection header received
0808 07:01:47.004661 (+ 996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.004662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.004673 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.004732 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.005302 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.005847 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.006813 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.007015 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.007066 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.009237 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.009239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.009239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.009250 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.010605 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.011067 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.011068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.011069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.011134 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.011390 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.011390 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.011390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.011483 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.011527 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.011824 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.011903 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:01:47.012274 27968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.003367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:35699 (local address 127.26.23.129:42333)
0808 07:01:47.003521 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.003563 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.004571 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.004796 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.004799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.005045 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:47.005238 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.005243 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.005914 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.005915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.006746 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.006749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.007088 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.007089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.007199 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.007589 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:47.007596 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:47.009136 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:47.010687 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:47.010695 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:47.010697 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:47.010987 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:47.011197 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:47.011198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:47.011198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:47.011331 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:47.011530 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:47.011535 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:47.011697 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.011806 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.011974 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260808 07:01:47.012810 27966 heartbeater.cc:347] Connected to a master server at 127.26.23.190:35699
I20260808 07:01:47.012897 27966 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:47.013062 27966 heartbeater.cc:511] Master 127.26.23.190:35699 requested a full tablet report, sending...
I20260808 07:01:47.013528 27647 ts_manager.cc:194] Registered new tserver with Master: fd87448a0c05451f8e91d723f43bcb80 (127.26.23.129:45363)
I20260808 07:01:47.014169 27647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:42333
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:01:47.032958 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:35699
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:47.113462 27974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:47.113655 27974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:47.113679 27974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:47.114780 27974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:47.114813 27974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:47.114838 27974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:01:47.116287 27974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:35699
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:47.116469 27974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:47.116642 27974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:47.121517 27988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:47.121585 27984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:47.121493 27992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:47.121699 27974 server_base.cc:1034] running on GCE node
I20260808 07:01:47.121901 27974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:47.122117 27974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:47.123286 27974 hybrid_clock.cc:648] HybridClock initialized: now 1786172507123271 us; error 28 us; skew 500 ppm
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:47.125771 27974 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:01:47.126209 27974 webserver.cc:460] Webserver started at http://127.26.23.130:34089/ using document root <none> and password file <none>
I20260808 07:01:47.126408 27974 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:47.126457 27974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:47.126585 27974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:47.127594 27974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "44c0e4e9ebc644a09512be8b1db48fb7"
format_stamp: "Formatted at 2026-08-08 07:01:47 on dist-test-slave-zj8q"
server_key: "317198e6709729efefcaeff3e545a7a1"
server_key_iv: "228beb9ccccacb4a64034ed1ff8ca4c6"
server_key_version: "encryptionkey@0"
I20260808 07:01:47.127920 27974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "44c0e4e9ebc644a09512be8b1db48fb7"
format_stamp: "Formatted at 2026-08-08 07:01:47 on dist-test-slave-zj8q"
server_key: "317198e6709729efefcaeff3e545a7a1"
server_key_iv: "228beb9ccccacb4a64034ed1ff8ca4c6"
server_key_version: "encryptionkey@0"
I20260808 07:01:47.129154 27974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:01:47.129882 28008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.130028 27974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:47.130115 27974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "44c0e4e9ebc644a09512be8b1db48fb7"
format_stamp: "Formatted at 2026-08-08 07:01:47 on dist-test-slave-zj8q"
server_key: "317198e6709729efefcaeff3e545a7a1"
server_key_iv: "228beb9ccccacb4a64034ed1ff8ca4c6"
server_key_version: "encryptionkey@0"
I20260808 07:01:47.130203 27974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:47.146466 27974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:47.148139 27974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:47.148274 27974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:47.148468 27974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:47.148751 27974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:47.148784 27974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.148811 27974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:47.148829 27974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.154311 27974 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:42955
I20260808 07:01:47.154382 28200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:42955 every 8 connection(s)
I20260808 07:01:47.154663 27974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:01:47.157673 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27974
I20260808 07:01:47.157758 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:01:47.157924 26718 external_mini_cluster.cc:1428] Setting key 1b5bb2cc5abd03c5c5e0c5d9cf6f8d8b
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:47.164144 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.155378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:55255 (local address 127.26.23.190:35699)
0808 07:01:47.155431 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.155434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.155634 (+ 200us) server_negotiation.cc:407] Connection header received
0808 07:01:47.156540 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.156541 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.156551 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.156591 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.157208 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.157862 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.159091 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.159364 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.159431 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.161535 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.161537 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.161537 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.161544 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.162786 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.163251 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.163252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.163252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.163302 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.163568 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.163568 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.163568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.163661 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.163706 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.164005 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.164073 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:01:47.164409 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.155347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:35699 (local address 127.26.23.130:55255)
0808 07:01:47.155510 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.155548 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.156445 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.156661 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.156664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.156927 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:47.157140 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.157146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.157945 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.157946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.158982 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.158985 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.159434 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.159435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.159543 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.159982 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:47.159990 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:47.161449 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:47.162877 (+ 1428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:47.162885 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:47.162888 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:47.163181 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:47.163355 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:47.163356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:47.163356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:47.163488 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:47.163714 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:47.163720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:47.163881 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.163998 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.164175 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260808 07:01:47.164934 28201 heartbeater.cc:347] Connected to a master server at 127.26.23.190:35699
I20260808 07:01:47.165021 28201 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:47.165190 28201 heartbeater.cc:511] Master 127.26.23.190:35699 requested a full tablet report, sending...
I20260808 07:01:47.165577 27647 ts_manager.cc:194] Registered new tserver with Master: 44c0e4e9ebc644a09512be8b1db48fb7 (127.26.23.130:42955)
I20260808 07:01:47.166074 27647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:55255
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:01:47.183167 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:35699
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:47.263554 28206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:47.263795 28206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:47.263818 28206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:47.265081 28206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:47.265136 28206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:47.265161 28206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:01:47.266712 28206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:35699
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:47.266928 28206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:47.267148 28206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:47.271974 28213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:47.272001 28219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:47.271981 28215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:47.272020 28206 server_base.cc:1034] running on GCE node
I20260808 07:01:47.272403 28206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:47.272617 28206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:47.273759 28206 hybrid_clock.cc:648] HybridClock initialized: now 1786172507273743 us; error 32 us; skew 500 ppm
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:47.276237 28206 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:01:47.276651 28206 webserver.cc:460] Webserver started at http://127.26.23.131:38101/ using document root <none> and password file <none>
I20260808 07:01:47.276836 28206 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:47.276878 28206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:47.276993 28206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:47.277959 28206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "f08f7529bcd146adbbbe6c4e0e70319b"
format_stamp: "Formatted at 2026-08-08 07:01:47 on dist-test-slave-zj8q"
server_key: "d4e19a4c34710f30b8b9589df466d8fd"
server_key_iv: "b153bf9ef3ce9e63faa2b61c1d3917e5"
server_key_version: "encryptionkey@0"
I20260808 07:01:47.278311 28206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "f08f7529bcd146adbbbe6c4e0e70319b"
format_stamp: "Formatted at 2026-08-08 07:01:47 on dist-test-slave-zj8q"
server_key: "d4e19a4c34710f30b8b9589df466d8fd"
server_key_iv: "b153bf9ef3ce9e63faa2b61c1d3917e5"
server_key_version: "encryptionkey@0"
I20260808 07:01:47.279659 28206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:01:47.280469 28232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.280637 28206 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:47.280731 28206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "f08f7529bcd146adbbbe6c4e0e70319b"
format_stamp: "Formatted at 2026-08-08 07:01:47 on dist-test-slave-zj8q"
server_key: "d4e19a4c34710f30b8b9589df466d8fd"
server_key_iv: "b153bf9ef3ce9e63faa2b61c1d3917e5"
server_key_version: "encryptionkey@0"
I20260808 07:01:47.280802 28206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:47.295571 28206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:47.297294 28206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:47.297420 28206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:47.297636 28206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:47.297921 28206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:47.297955 28206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.297981 28206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:47.298005 28206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:47.303490 28206 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:37899
I20260808 07:01:47.303550 28428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:37899 every 8 connection(s)
I20260808 07:01:47.303826 28206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:01:47.307814 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28206
I20260808 07:01:47.307900 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:01:47.308055 26718 external_mini_cluster.cc:1428] Setting key fecbb0661e5b251a929372b7de4cf2d7
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:47.312767 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.304451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:40063 (local address 127.26.23.190:35699)
0808 07:01:47.304493 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.304495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.304692 (+ 197us) server_negotiation.cc:407] Connection header received
0808 07:01:47.305730 (+ 1038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.305732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.305745 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.305796 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.306441 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.306946 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.308029 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.308275 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.308342 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.310470 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.310471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.310471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.310479 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.311524 (+ 1045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.311881 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.311882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.311883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.311946 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.312166 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.312166 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.312167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.312280 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.312336 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.312586 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.312677 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:01:47.312903 28431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.304431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:35699 (local address 127.26.23.131:40063)
0808 07:01:47.304578 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.304613 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.305628 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.305860 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.305864 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.306124 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:47.306355 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.306360 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.307028 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.307029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.307904 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.307908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.308356 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.308357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.308517 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.308964 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:47.308973 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:47.310386 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:47.311594 (+ 1208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:47.311601 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:47.311603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:47.311813 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:47.312000 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:47.312001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:47.312001 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:47.312109 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:47.312333 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:47.312340 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:47.312469 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.312555 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.312704 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260808 07:01:47.313330 28429 heartbeater.cc:347] Connected to a master server at 127.26.23.190:35699
I20260808 07:01:47.313421 28429 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:47.313586 28429 heartbeater.cc:511] Master 127.26.23.190:35699 requested a full tablet report, sending...
I20260808 07:01:47.313930 27647 ts_manager.cc:194] Registered new tserver with Master: f08f7529bcd146adbbbe6c4e0e70319b (127.26.23.131:37899)
I20260808 07:01:47.314311 27647 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:40063
I20260808 07:01:47.319597 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:01:47.326081 27709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.321041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47138 (local address 127.26.23.190:35699)
0808 07:01:47.321082 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.321084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.321180 (+ 96us) server_negotiation.cc:407] Connection header received
0808 07:01:47.321221 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.321222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.321230 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.321277 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.321775 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.322286 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.322927 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.323097 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.323137 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.324130 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.324131 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.324131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.324135 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.325205 (+ 1070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.325496 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.325497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.325497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.325553 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.325693 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.325694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.325694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.325817 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.325893 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.325962 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.326021 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:01:47.327924 27647 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47138:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:01:47.329432 27647 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:47.335300 28439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.331383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:37899 (local address 127.0.0.1:43934)
0808 07:01:47.331643 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.331682 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.331745 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.332091 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.332092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.332095 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:47.332157 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.332159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.333378 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.333379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.334373 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.334375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.335009 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.335010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.335087 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.335101 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.335166 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.335214 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":42,"thread_start_us":52,"threads_started":1}
I20260808 07:01:47.335309 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.331519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45066 (local address 127.26.23.130:42955)
0808 07:01:47.331720 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.331724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.331735 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:01:47.331819 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.331821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.331843 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.331911 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:47.332048 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.333133 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.334429 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.334936 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.335000 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.335056 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.335192 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.335230 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":93,"threads_started":1}
I20260808 07:01:47.335530 28440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.331471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43934 (local address 127.26.23.131:37899)
0808 07:01:47.331958 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.331961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.331970 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:47.332000 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.332001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.332012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.332078 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:47.332237 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.333294 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.334456 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.334932 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.334995 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.335051 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.335419 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.335458 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":91,"threads_started":1}
I20260808 07:01:47.335304 28438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.331345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:42955 (local address 127.0.0.1:45066)
0808 07:01:47.331639 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.331680 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.331745 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.331920 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.331924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.331926 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:47.331987 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.331989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.333238 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.333239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.334355 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.334358 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.335015 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.335016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.335097 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.335101 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.335172 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.335223 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":29,"thread_start_us":44,"threads_started":1}
I20260808 07:01:47.336189 28310 tablet_service.cc:1467] Processing CreateTablet for tablet 4aa645fe87414fe4a0c89414b7d880fd (DEFAULT_TABLE table=test-table [id=e493abeee78b4b5798095219671a8e5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:47.336265 28085 tablet_service.cc:1467] Processing CreateTablet for tablet 4aa645fe87414fe4a0c89414b7d880fd (DEFAULT_TABLE table=test-table [id=e493abeee78b4b5798095219671a8e5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:47.336556 28085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aa645fe87414fe4a0c89414b7d880fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:47.336556 28310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aa645fe87414fe4a0c89414b7d880fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:47.337036 28441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.331518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:45363 (local address 127.0.0.1:43142)
0808 07:01:47.332169 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.332178 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.332223 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.332587 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.332588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.332590 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:47.332634 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.332636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.333612 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.333613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.336121 (+ 2508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.336124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.336823 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.336824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.336884 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.336888 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.336935 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.336973 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":56,"threads_started":1}
I20260808 07:01:47.337062 28444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.331750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43142 (local address 127.26.23.129:45363)
0808 07:01:47.331898 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.331903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.332298 (+ 395us) server_negotiation.cc:407] Connection header received
0808 07:01:47.332346 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.332348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.332364 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.332502 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:47.332712 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.333513 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.336197 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.336756 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.336814 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.336866 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.336954 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.336991 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":83,"threads_started":1}
I20260808 07:01:47.338807 27854 tablet_service.cc:1467] Processing CreateTablet for tablet 4aa645fe87414fe4a0c89414b7d880fd (DEFAULT_TABLE table=test-table [id=e493abeee78b4b5798095219671a8e5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:47.339121 27854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4aa645fe87414fe4a0c89414b7d880fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:47.339793 28445 tablet_bootstrap.cc:492] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: Bootstrap starting.
I20260808 07:01:47.339951 28446 tablet_bootstrap.cc:492] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: Bootstrap starting.
I20260808 07:01:47.340482 28446 tablet_bootstrap.cc:654] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:47.340531 28445 tablet_bootstrap.cc:654] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:47.340929 28446 log.cc:824] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:47.341161 28445 log.cc:824] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:47.341786 28446 tablet_bootstrap.cc:492] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: No bootstrap required, opened a new log
I20260808 07:01:47.341846 28446 ts_tablet_manager.cc:1397] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:47.341939 28445 tablet_bootstrap.cc:492] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: No bootstrap required, opened a new log
I20260808 07:01:47.342000 28445 ts_tablet_manager.cc:1397] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:47.342188 28455 tablet_bootstrap.cc:492] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: Bootstrap starting.
I20260808 07:01:47.342818 28455 tablet_bootstrap.cc:654] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:47.343333 28455 log.cc:824] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:47.343427 28445 raft_consensus.cc:348] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.343567 28445 raft_consensus.cc:374] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:47.343611 28445 raft_consensus.cc:729] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08f7529bcd146adbbbe6c4e0e70319b, State: Initialized, Role: FOLLOWER
I20260808 07:01:47.343729 28445 consensus_queue.cc:260] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.343765 28446 raft_consensus.cc:348] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.343928 28446 raft_consensus.cc:374] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:47.343964 28446 raft_consensus.cc:729] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c0e4e9ebc644a09512be8b1db48fb7, State: Initialized, Role: FOLLOWER
I20260808 07:01:47.344007 28429 heartbeater.cc:503] Master 127.26.23.190:35699 was elected leader, sending a full tablet report...
I20260808 07:01:47.344079 28455 tablet_bootstrap.cc:492] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: No bootstrap required, opened a new log
I20260808 07:01:47.344074 28446 consensus_queue.cc:260] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.344142 28455 ts_tablet_manager.cc:1397] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:01:47.343997 28445 ts_tablet_manager.cc:1428] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:47.344331 28446 ts_tablet_manager.cc:1428] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:47.344360 28201 heartbeater.cc:503] Master 127.26.23.190:35699 was elected leader, sending a full tablet report...
I20260808 07:01:47.345844 28455 raft_consensus.cc:348] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.345973 28455 raft_consensus.cc:374] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:47.346004 28455 raft_consensus.cc:729] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd87448a0c05451f8e91d723f43bcb80, State: Initialized, Role: FOLLOWER
I20260808 07:01:47.346107 28455 consensus_queue.cc:260] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.346375 28455 ts_tablet_manager.cc:1428] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:47.346427 27966 heartbeater.cc:503] Master 127.26.23.190:35699 was elected leader, sending a full tablet report...
W20260808 07:01:47.405254 28202 tablet.cc:2369] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:01:47.503455 27967 tablet.cc:2369] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:01:47.554396 28430 tablet.cc:2369] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:01:47.622952 28461 raft_consensus.cc:482] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:47.623087 28461 raft_consensus.cc:504] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.623415 28461 leader_election.cc:288] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44c0e4e9ebc644a09512be8b1db48fb7 (127.26.23.130:42955), f08f7529bcd146adbbbe6c4e0e70319b (127.26.23.131:37899)
I20260808 07:01:47.626183 28440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.623721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:57969 (local address 127.26.23.131:37899)
0808 07:01:47.623772 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.623774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.623785 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:01:47.623864 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.623865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.623874 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.623914 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:47.624072 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.624531 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.625468 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.625855 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.625918 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.625927 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.626062 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.626096 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:01:47.626199 28462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.623594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:37899 (local address 127.26.23.129:57969)
0808 07:01:47.623730 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.623743 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.623799 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.623930 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.623931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.623933 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:47.624011 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.624013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.624605 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.624606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.625380 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.625383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.625936 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.625936 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.625999 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.626003 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.626048 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.626088 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":3,"thread_start_us":67,"threads_started":1}
I20260808 07:01:47.626277 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.623729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:40801 (local address 127.26.23.130:42955)
0808 07:01:47.623798 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.623800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.623809 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:47.623867 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.623868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.623877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.623921 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:47.624084 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.624572 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.625544 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.625935 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.626001 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.626009 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.626173 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.626209 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 07:01:47.626310 28467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.623599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:42955 (local address 127.26.23.129:40801)
0808 07:01:47.623744 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:47.623754 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:47.623812 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:47.623934 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:47.623935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:47.623937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:47.624020 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.624022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.624663 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.624664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.625438 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:47.625440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.626014 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.626015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:47.626083 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.626086 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:01:47.626138 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:01:47.626194 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":4,"thread_start_us":83,"threads_started":1}
I20260808 07:01:47.626603 28125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aa645fe87414fe4a0c89414b7d880fd" candidate_uuid: "fd87448a0c05451f8e91d723f43bcb80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" is_pre_election: true
I20260808 07:01:47.626688 28344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aa645fe87414fe4a0c89414b7d880fd" candidate_uuid: "fd87448a0c05451f8e91d723f43bcb80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" is_pre_election: true
I20260808 07:01:47.626781 28125 raft_consensus.cc:2454] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd87448a0c05451f8e91d723f43bcb80 in term 0.
I20260808 07:01:47.626811 28344 raft_consensus.cc:2454] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd87448a0c05451f8e91d723f43bcb80 in term 0.
I20260808 07:01:47.627024 27774 leader_election.cc:302] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44c0e4e9ebc644a09512be8b1db48fb7, fd87448a0c05451f8e91d723f43bcb80; no voters:
I20260808 07:01:47.627183 28461 raft_consensus.cc:2781] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:47.627244 28461 raft_consensus.cc:482] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:47.627261 28461 raft_consensus.cc:3037] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:47.627949 28461 raft_consensus.cc:504] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.628070 28461 leader_election.cc:288] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [CANDIDATE]: Term 1 election: Requested vote from peers 44c0e4e9ebc644a09512be8b1db48fb7 (127.26.23.130:42955), f08f7529bcd146adbbbe6c4e0e70319b (127.26.23.131:37899)
I20260808 07:01:47.628226 28344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aa645fe87414fe4a0c89414b7d880fd" candidate_uuid: "fd87448a0c05451f8e91d723f43bcb80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08f7529bcd146adbbbe6c4e0e70319b"
I20260808 07:01:47.628224 28125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4aa645fe87414fe4a0c89414b7d880fd" candidate_uuid: "fd87448a0c05451f8e91d723f43bcb80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44c0e4e9ebc644a09512be8b1db48fb7"
I20260808 07:01:47.628293 28344 raft_consensus.cc:3037] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:47.628310 28125 raft_consensus.cc:3037] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:47.628953 28344 raft_consensus.cc:2454] T 4aa645fe87414fe4a0c89414b7d880fd P f08f7529bcd146adbbbe6c4e0e70319b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd87448a0c05451f8e91d723f43bcb80 in term 1.
I20260808 07:01:47.629034 28125 raft_consensus.cc:2454] T 4aa645fe87414fe4a0c89414b7d880fd P 44c0e4e9ebc644a09512be8b1db48fb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd87448a0c05451f8e91d723f43bcb80 in term 1.
I20260808 07:01:47.629130 27773 leader_election.cc:302] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f08f7529bcd146adbbbe6c4e0e70319b, fd87448a0c05451f8e91d723f43bcb80; no voters:
I20260808 07:01:47.629212 28461 raft_consensus.cc:2781] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:47.629361 28461 raft_consensus.cc:686] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [term 1 LEADER]: Becoming Leader. State: Replica: fd87448a0c05451f8e91d723f43bcb80, State: Running, Role: LEADER
I20260808 07:01:47.629477 28461 consensus_queue.cc:237] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } }
I20260808 07:01:47.630296 27646 catalog_manager.cc:5495] T 4aa645fe87414fe4a0c89414b7d880fd P fd87448a0c05451f8e91d723f43bcb80 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd87448a0c05451f8e91d723f43bcb80 (127.26.23.129). New cstate: current_term: 1 leader_uuid: "fd87448a0c05451f8e91d723f43bcb80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44c0e4e9ebc644a09512be8b1db48fb7" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd87448a0c05451f8e91d723f43bcb80" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08f7529bcd146adbbbe6c4e0e70319b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 37899 } health_report { overall_health: UNKNOWN } } }
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:01:47.691779 28444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.684817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43158 (local address 127.26.23.129:45363)
0808 07:01:47.684874 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.684877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.684984 (+ 107us) server_negotiation.cc:407] Connection header received
0808 07:01:47.685055 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.685056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.685067 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.685127 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.685689 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.686202 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.686877 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.687067 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.687128 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.689318 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.689332 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.689333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.689340 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.690716 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.691021 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.691025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.691025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.691092 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.691266 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.691266 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.691267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.691406 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.691540 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.691602 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.691684 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:01:47.713792 28444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.707742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43162 (local address 127.26.23.129:45363)
0808 07:01:47.707794 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.707796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.707885 (+ 89us) server_negotiation.cc:407] Connection header received
0808 07:01:47.707951 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.707952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.707961 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.708005 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.708488 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.708934 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.709588 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.709781 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.709835 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.711784 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.711785 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.711786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.711793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.712784 (+ 991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.713066 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.713067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.713067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.713135 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.713298 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.713299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.713299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.713388 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.713491 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.713628 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.713703 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[27580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:01:47.735000 28444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:47.728453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43166 (local address 127.26.23.129:45363)
0808 07:01:47.728506 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:47.728508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:47.728567 (+ 59us) server_negotiation.cc:407] Connection header received
0808 07:01:47.728645 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:47.728646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:47.728657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:47.728701 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:47.729203 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.729677 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.730460 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:47.730644 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:47.730695 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:47.732702 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:47.732703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:47.732704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:47.732710 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:47.733953 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.734292 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.734292 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.734293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.734341 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:47.734477 (+ 136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:47.734478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:47.734478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:47.734597 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:47.734732 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:47.734861 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 07:01:47.734922 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 07:01:47.735500 27820 tablet_service.cc:2908] Rejecting scan request for tablet 4aa645fe87414fe4a0c89414b7d880fd: Uninitialized: clean time has not yet been initialized
I20260808 07:01:47.736303 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27745
I20260808 07:01:47.749511 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27974
I20260808 07:01:47.766853 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28206
I20260808 07:01:47.776842 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27603
2026-08-08T07:01:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2344 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[28488](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[28488](info): set up 2 sockets
Aug 08 07:01:47 dist-test-slave-zj8q krb5kdc[28488](info): commencing operation
krb5kdc: starting...
W20260808 07:01:48.915685 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:01:48 dist-test-slave-zj8q krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:01:49.028100 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33027
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:33027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:49.107999 28512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:49.108187 28512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:49.108206 28512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:49.109264 28512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:01:49.109298 28512 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:01:49.109313 28512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:49.109324 28512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:49.109335 28512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:01:49.109346 28512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:01:49.110755 28512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:33027
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:49.110934 28512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:49.111099 28512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:49.115682 28526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.115711 28524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.115654 28522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:49.115936 28512 server_base.cc:1034] running on GCE node
I20260808 07:01:49.116144 28512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:49.116367 28512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:49.117492 28512 hybrid_clock.cc:648] HybridClock initialized: now 1786172509117483 us; error 27 us; skew 500 ppm
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:49.123164 28512 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:01:49.123586 28512 webserver.cc:460] Webserver started at http://127.26.23.190:46019/ using document root <none> and password file <none>
I20260808 07:01:49.123808 28512 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:49.123855 28512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:49.123978 28512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:49.125005 28512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "9761cdfdccf643e5b40088746d5f155a"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "60f31a124001f2d2c3c4f83fc497b2aa"
server_key_iv: "ff36edc48823496297629bb2dd26145d"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.125336 28512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "9761cdfdccf643e5b40088746d5f155a"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "60f31a124001f2d2c3c4f83fc497b2aa"
server_key_iv: "ff36edc48823496297629bb2dd26145d"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.126626 28512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:01:49.127345 28534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.127516 28512 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:49.127591 28512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "9761cdfdccf643e5b40088746d5f155a"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "60f31a124001f2d2c3c4f83fc497b2aa"
server_key_iv: "ff36edc48823496297629bb2dd26145d"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.127679 28512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:49.140095 28512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:49.141834 28512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:49.141963 28512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:49.146581 28512 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:33027
I20260808 07:01:49.146649 28644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:33027 every 8 connection(s)
I20260808 07:01:49.146934 28512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:01:49.147541 28645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.149866 28645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: Bootstrap starting.
I20260808 07:01:49.150492 28645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.150767 28645 log.cc:824] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:49.151414 28645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: No bootstrap required, opened a new log
I20260808 07:01:49.152822 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28512
I20260808 07:01:49.152928 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:01:49.153090 26718 external_mini_cluster.cc:1428] Setting key 4ad930386a2bd8f8e9eed215eebd9880
I20260808 07:01:49.153887 28645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9761cdfdccf643e5b40088746d5f155a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33027 } }
I20260808 07:01:49.154031 28645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.154053 28645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9761cdfdccf643e5b40088746d5f155a, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.154208 28645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9761cdfdccf643e5b40088746d5f155a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33027 } }
I20260808 07:01:49.154302 28645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:01:49.154345 28645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:01:49.154394 28645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.155082 28645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9761cdfdccf643e5b40088746d5f155a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33027 } }
I20260808 07:01:49.155185 28645 leader_election.cc:302] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9761cdfdccf643e5b40088746d5f155a; no voters:
I20260808 07:01:49.155337 28645 leader_election.cc:288] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:01:49.155390 28651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:49.155545 28651 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [term 1 LEADER]: Becoming Leader. State: Replica: 9761cdfdccf643e5b40088746d5f155a, State: Running, Role: LEADER
I20260808 07:01:49.155601 28645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:01:49.155715 28651 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9761cdfdccf643e5b40088746d5f155a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33027 } }
I20260808 07:01:49.157338 28653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9761cdfdccf643e5b40088746d5f155a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9761cdfdccf643e5b40088746d5f155a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33027 } } }
I20260808 07:01:49.157523 28653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [sys.catalog]: This master's current role is: LEADER
W20260808 07:01:49.157526 28676 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:01:49.157719 28676 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:01:49.157500 28655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9761cdfdccf643e5b40088746d5f155a. Latest consensus state: current_term: 1 leader_uuid: "9761cdfdccf643e5b40088746d5f155a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9761cdfdccf643e5b40088746d5f155a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33027 } } }
I20260808 07:01:49.157804 28655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:49.157898 28680 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:01:49.158051 28680 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:01:49.159673 28680 catalog_manager.cc:1347] Generated new cluster ID: 97869d1e21a44b78970c09881ae3a53a
I20260808 07:01:49.159729 28680 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:49.163443 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.153638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43478 (local address 127.26.23.190:33027)
0808 07:01:49.153836 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.153844 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.153869 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:01:49.153964 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.153969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.154014 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.154184 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.155023 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.156347 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.157253 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.157762 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.157866 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.160418 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.160422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.160422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.160435 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.161960 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.162352 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.162355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.162355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.162463 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.162651 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.162652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.162653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.162883 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.163045 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.163123 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.163261 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":101,"threads_started":1}
I20260808 07:01:49.194334 28680 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:01:49.195077 28680 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:01:49.201905 28680 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: Generated new TSK 0
I20260808 07:01:49.202092 28680 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:01:49.236513 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33027
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:49.318843 28687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:49.319041 28687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:49.319073 28687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:49.320194 28687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:49.320232 28687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:49.320259 28687 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:01:49.320282 28687 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:01:49.321691 28687 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:33027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:49.321913 28687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:49.322113 28687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:49.326933 28698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:49.326968 28687 server_base.cc:1034] running on GCE node
W20260808 07:01:49.326941 28697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.326941 28700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:49.327354 28687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:49.327598 28687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:49.328760 28687 hybrid_clock.cc:648] HybridClock initialized: now 1786172509328742 us; error 33 us; skew 500 ppm
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:49.331386 28687 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:01:49.331763 28687 webserver.cc:460] Webserver started at http://127.26.23.129:41527/ using document root <none> and password file <none>
I20260808 07:01:49.331930 28687 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:49.331969 28687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:49.332070 28687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:49.333055 28687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "9c278637840e43e0bc084c5e010562c1"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "21d2b2af8a6000d8aaf03cad44896c8b"
server_key_iv: "e7c5559f80e0cae9f09fef197df10f79"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.333352 28687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "9c278637840e43e0bc084c5e010562c1"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "21d2b2af8a6000d8aaf03cad44896c8b"
server_key_iv: "e7c5559f80e0cae9f09fef197df10f79"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.334576 28687 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:01:49.335246 28711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.335402 28687 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:49.335482 28687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "9c278637840e43e0bc084c5e010562c1"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "21d2b2af8a6000d8aaf03cad44896c8b"
server_key_iv: "e7c5559f80e0cae9f09fef197df10f79"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.335536 28687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:49.352702 28687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:49.354347 28687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:49.354455 28687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:49.354888 28687 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:49.354923 28687 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.354943 28687 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:49.354956 28687 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.361765 28687 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:41309
I20260808 07:01:49.361851 28894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:41309 every 8 connection(s)
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:49.362116 28687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:01:49.364907 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.355473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:40791 (local address 127.26.23.190:33027)
0808 07:01:49.355552 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.355555 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.355770 (+ 215us) server_negotiation.cc:407] Connection header received
0808 07:01:49.356321 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.356322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.356335 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.356392 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.357383 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.358144 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.359611 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.359919 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.359973 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.362566 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.362568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.362568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.362575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.363845 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.364173 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.364174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.364174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.364219 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.364373 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.364373 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.364373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.364492 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.364542 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.364774 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.364844 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 07:01:49.365022 28724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.355435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.26.23.129:40791)
0808 07:01:49.355645 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.355685 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.356226 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.356498 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.356503 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.356931 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.357260 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.357268 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.358247 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.358248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.359517 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.359521 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.360002 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.360004 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.360158 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.360689 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.360699 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.362485 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.363909 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.363913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.363915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.364110 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.364255 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.364255 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.364256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.364334 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.364552 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.364559 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.364670 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.364750 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.364861 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":80,"threads_started":1}
I20260808 07:01:49.365491 28895 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33027
I20260808 07:01:49.365577 28895 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:49.365780 28895 heartbeater.cc:511] Master 127.26.23.190:33027 requested a full tablet report, sending...
I20260808 07:01:49.366348 28563 ts_manager.cc:194] Registered new tserver with Master: 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309)
I20260808 07:01:49.367197 28563 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:40791
I20260808 07:01:49.371421 28903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.366590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.26.23.129:36697)
0808 07:01:49.366730 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.366741 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.366799 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.366901 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.366902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.367097 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.367161 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.367163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.367878 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.367879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.368375 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.368376 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.368679 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.368679 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.368731 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.369073 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.369077 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.369347 (+ 270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.370553 (+ 1206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.370553 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.370554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.370713 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.370972 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.370972 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.370973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.371017 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.371192 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.371192 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.371244 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.371291 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.371360 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260808 07:01:49.371476 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.366668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36697 (local address 127.26.23.190:33027)
0808 07:01:49.366711 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.366713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.366785 (+ 72us) server_negotiation.cc:407] Connection header received
0808 07:01:49.366847 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.366848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.366855 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.366896 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.367223 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.367789 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.368438 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.368613 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.368668 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.369406 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.369407 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.369407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.369411 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.370486 (+ 1075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.370853 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.370855 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.370855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.370912 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.371060 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.371060 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.371061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.371150 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.371196 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.371343 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.371408 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:01:49.371747 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28687
I20260808 07:01:49.371836 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:01:49.371976 26718 external_mini_cluster.cc:1428] Setting key 0bf89885a04a2af280da16876ea346a1
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:01:49.394851 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33027
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:49.474889 28908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:49.475080 28908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:49.475103 28908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:49.476214 28908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:49.476254 28908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:49.476276 28908 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:01:49.476307 28908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:01:49.477697 28908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:33027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:49.477898 28908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:49.478099 28908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:49.482856 28917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.482852 28920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.482875 28918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:49.483012 28908 server_base.cc:1034] running on GCE node
I20260808 07:01:49.483286 28908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:49.483511 28908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:49.484719 28908 hybrid_clock.cc:648] HybridClock initialized: now 1786172509484700 us; error 29 us; skew 500 ppm
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:49.487159 28908 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:01:49.487550 28908 webserver.cc:460] Webserver started at http://127.26.23.130:36291/ using document root <none> and password file <none>
I20260808 07:01:49.487736 28908 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:49.487776 28908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:49.487866 28908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:49.488807 28908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "8597168ba4aa4d62b9897a23d365f252"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "0d99b243c196e36e8bf4d128364d687b"
server_key_iv: "ae626972c4101ba45a795026e0d2f017"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.489094 28908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "8597168ba4aa4d62b9897a23d365f252"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "0d99b243c196e36e8bf4d128364d687b"
server_key_iv: "ae626972c4101ba45a795026e0d2f017"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.490270 28908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:01:49.490954 28930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.491103 28908 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.491189 28908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "8597168ba4aa4d62b9897a23d365f252"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "0d99b243c196e36e8bf4d128364d687b"
server_key_iv: "ae626972c4101ba45a795026e0d2f017"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.491247 28908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:49.507031 28908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:49.509016 28908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:49.509150 28908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:49.509599 28908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:49.509644 28908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.509671 28908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:49.509687 28908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:49.516462 28908 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:41211
I20260808 07:01:49.516531 29111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:41211 every 8 connection(s)
I20260808 07:01:49.516839 28908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:01:49.518851 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.510050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:35855 (local address 127.26.23.190:33027)
0808 07:01:49.510089 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.510091 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.510337 (+ 246us) server_negotiation.cc:407] Connection header received
0808 07:01:49.510846 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.510847 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.510861 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.510914 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.511566 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.512096 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.513135 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.513405 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.513462 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.516293 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.516295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.516295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.516302 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.517634 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.518007 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.518009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.518009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.518076 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.518360 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.518360 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.518361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.518467 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.518517 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.518718 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.518787 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:01:49.518950 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.510045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.26.23.130:35855)
0808 07:01:49.510226 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.510260 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.510747 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.510978 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.510983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.511298 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.511476 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.511481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.512188 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.512190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.513045 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.513048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.513478 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.513479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.513608 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.514071 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.514080 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.516199 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.517712 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.517714 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.517716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.517913 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.518146 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.518147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.518147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.518304 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.518508 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.518511 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.518615 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.518682 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.518795 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260808 07:01:49.519258 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28908
I20260808 07:01:49.519337 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:01:49.519343 29112 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33027
I20260808 07:01:49.519409 29112 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:49.519508 26718 external_mini_cluster.cc:1428] Setting key 27b39869ebbcc944a1defb021c674251
I20260808 07:01:49.519547 29112 heartbeater.cc:511] Master 127.26.23.190:33027 requested a full tablet report, sending...
I20260808 07:01:49.519887 28559 ts_manager.cc:194] Registered new tserver with Master: 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211)
I20260808 07:01:49.520358 28559 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:35855
I20260808 07:01:49.527110 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.520491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:37673 (local address 127.26.23.190:33027)
0808 07:01:49.521853 (+ 1362us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.521855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.521862 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:01:49.521880 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.521881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.521890 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.521941 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.522355 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.522839 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.523731 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.523909 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.523959 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.524913 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.524915 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.524915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.524921 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.526097 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.526458 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.526459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.526459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.526506 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.526681 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.526681 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.526681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.526801 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.526847 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.526994 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.527052 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1339}
I20260808 07:01:49.527184 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.520330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.26.23.130:37673)
0808 07:01:49.520505 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.520517 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.520569 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.521965 (+ 1396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.521967 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.522213 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.522276 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.522278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.522934 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.522935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.523651 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.523654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.523985 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.523986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.524067 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.524470 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.524475 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.524828 (+ 353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.526192 (+ 1364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.526193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.526193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.526392 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.526556 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.526557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.526557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.526623 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.526855 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.526856 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.526903 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.526977 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.527071 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:01:49.544823 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33027
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:32939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:49.625059 29125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:49.625247 29125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:49.625268 29125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:49.626425 29125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:49.626466 29125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:49.626487 29125 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:01:49.626515 29125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:01:49.627928 29125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:33027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:49.628137 29125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:49.628355 29125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:49.633481 29134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.633540 29141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:49.633553 29135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:49.633777 29125 server_base.cc:1034] running on GCE node
I20260808 07:01:49.633973 29125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:49.634264 29125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:49.635413 29125 hybrid_clock.cc:648] HybridClock initialized: now 1786172509635404 us; error 28 us; skew 500 ppm
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:49.637779 29125 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:01:49.638273 29125 webserver.cc:460] Webserver started at http://127.26.23.131:40915/ using document root <none> and password file <none>
I20260808 07:01:49.638496 29125 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:49.638543 29125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:49.638671 29125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:49.639691 29125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "a2a571dc629d462cae0e40b558d10732"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "a08280593dc7b726ef348a0c71be69cc"
server_key_iv: "9ded89a1c3f9773223d84d565f6c85a6"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.640023 29125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "a2a571dc629d462cae0e40b558d10732"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "a08280593dc7b726ef348a0c71be69cc"
server_key_iv: "9ded89a1c3f9773223d84d565f6c85a6"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.641249 29125 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:01:49.641903 29151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.642073 29125 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:49.642180 29125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "a2a571dc629d462cae0e40b558d10732"
format_stamp: "Formatted at 2026-08-08 07:01:49 on dist-test-slave-zj8q"
server_key: "a08280593dc7b726ef348a0c71be69cc"
server_key_iv: "9ded89a1c3f9773223d84d565f6c85a6"
server_key_version: "encryptionkey@0"
I20260808 07:01:49.642251 29125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:49.661556 29125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:49.663277 29125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:49.663420 29125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:49.663913 29125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:49.663951 29125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.663978 29125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:49.664011 29125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:49.671370 29125 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:44441
I20260808 07:01:49.671721 29125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:01:49.672425 29332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:44441 every 8 connection(s)
I20260808 07:01:49.673317 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.664257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:54825 (local address 127.26.23.190:33027)
0808 07:01:49.664317 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.664319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.664551 (+ 232us) server_negotiation.cc:407] Connection header received
0808 07:01:49.665182 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.665183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.665194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.665239 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.666059 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.666634 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.667634 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.667824 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.667880 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.670537 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.670539 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.670539 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.670546 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.671981 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.672398 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.672400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.672400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.672459 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.672705 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.672706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.672707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.672824 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.672882 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.673139 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.673226 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:01:49.673446 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.664249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.26.23.131:54825)
0808 07:01:49.664414 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.664463 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.665064 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.665320 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.665325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.665692 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.665972 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.665979 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.666713 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.666715 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.667536 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.667539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.667892 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.667894 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.668018 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.668452 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.668461 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.670454 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.672098 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.672102 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.672104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.672331 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.672525 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.672526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.672526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.672642 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.672878 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.672884 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.673014 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.673102 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.673247 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260808 07:01:49.673852 29333 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33027
I20260808 07:01:49.673930 29333 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:49.674101 29333 heartbeater.cc:511] Master 127.26.23.190:33027 requested a full tablet report, sending...
I20260808 07:01:49.674484 28563 ts_manager.cc:194] Registered new tserver with Master: a2a571dc629d462cae0e40b558d10732 (127.26.23.131:44441)
I20260808 07:01:49.674945 28563 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:54825
I20260808 07:01:49.679373 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29125
I20260808 07:01:49.679466 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:01:49.679672 26718 external_mini_cluster.cc:1428] Setting key 8aa8aa7317ed9d0cc51ea0265b9443e6
I20260808 07:01:49.679795 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.674997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:49943 (local address 127.26.23.190:33027)
0808 07:01:49.675052 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.675054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.675196 (+ 142us) server_negotiation.cc:407] Connection header received
0808 07:01:49.675254 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.675255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.675266 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.675315 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.675596 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.676085 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.676727 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.676892 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.676932 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.677683 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.677684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.677684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.677688 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.678735 (+ 1047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.679036 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.679037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.679037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.679086 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.679239 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.679240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.679240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.679360 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.679456 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.679645 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.679718 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:01:49.680069 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.674923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.26.23.131:49943)
0808 07:01:49.675128 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.675138 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.675199 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.675326 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.675326 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.675468 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.675534 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.675535 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.676160 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.676160 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.676672 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.676674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.676936 (+ 262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.676936 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.676983 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.677343 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.677347 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.677620 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.678814 (+ 1194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.678815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.678816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.678973 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.679145 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.679145 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.679146 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.679191 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.679483 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.679484 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.679532 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.679875 (+ 343us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.679976 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":63,"threads_started":1}
I20260808 07:01:49.680568 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:49.702454 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.696261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43488 (local address 127.26.23.190:33027)
0808 07:01:49.696323 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.696325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.696335 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:01:49.696360 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.696361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.696372 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.696416 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.696961 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.697443 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.698146 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.698370 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.698422 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.700353 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.700355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.700355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.700362 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.701427 (+ 1065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.701746 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.701747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.701748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.701804 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.701967 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.701968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.701968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.702075 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.702192 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.702280 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.702357 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:01:49.703765 28559 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:01:49.705267 28559 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:49.711359 29367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.707510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:41211 (local address 127.0.0.1:50896)
0808 07:01:49.707823 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.707833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.707884 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.708280 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.708281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.708283 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.708324 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.708325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.709241 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.709242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.710304 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.710307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.711054 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.711055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.711142 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.711158 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.711232 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.711286 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":96,"threads_started":1}
I20260808 07:01:49.711565 29366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.707506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41309 (local address 127.0.0.1:33200)
0808 07:01:49.707671 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.707712 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.707777 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.708108 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.708112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.708114 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.708184 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.708186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.709473 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.709474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.710446 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.710448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.711355 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.711356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.711413 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.711417 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.711464 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.711501 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":48,"threads_started":1}
I20260808 07:01:49.711385 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.707751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50896 (local address 127.26.23.130:41211)
0808 07:01:49.708058 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.708063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.708072 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:49.708118 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.708120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.708135 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.708210 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.708386 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.709171 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.710386 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.710978 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.711049 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.711117 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.711248 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.711285 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":74,"threads_started":1}
I20260808 07:01:49.711823 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.707518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:44441 (local address 127.0.0.1:49744)
0808 07:01:49.707912 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.707921 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.707954 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.708612 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.708613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.708616 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.708666 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.708667 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.709794 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.709795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.710779 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.710782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.711614 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.711615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.711680 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.711684 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.711731 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.711762 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":74,"threads_started":1}
I20260808 07:01:49.711884 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.707742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49744 (local address 127.26.23.131:44441)
0808 07:01:49.708455 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.708459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.708468 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:49.708501 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.708503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.708518 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.708594 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.708737 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.709715 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.710862 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.711545 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.711622 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.711679 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.711753 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.711793 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":76,"threads_started":1}
I20260808 07:01:49.711854 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.707617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33200 (local address 127.26.23.129:41309)
0808 07:01:49.707944 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.707949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.707958 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:49.707996 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.707998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.708011 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.708073 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.708273 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.709368 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.710526 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.711211 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.711268 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.711322 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.711712 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.711753 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":86,"threads_started":1}
I20260808 07:01:49.712481 29229 tablet_service.cc:1467] Processing CreateTablet for tablet ae8764e26b014aca8a0729fb0fab541d (DEFAULT_TABLE table=test-table [id=84b9eee50b03496e84482e125b67fd9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:49.712491 29014 tablet_service.cc:1467] Processing CreateTablet for tablet ae8764e26b014aca8a0729fb0fab541d (DEFAULT_TABLE table=test-table [id=84b9eee50b03496e84482e125b67fd9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:49.712635 28792 tablet_service.cc:1467] Processing CreateTablet for tablet ae8764e26b014aca8a0729fb0fab541d (DEFAULT_TABLE table=test-table [id=84b9eee50b03496e84482e125b67fd9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:49.712838 29014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae8764e26b014aca8a0729fb0fab541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.712854 29229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae8764e26b014aca8a0729fb0fab541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.712924 28792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae8764e26b014aca8a0729fb0fab541d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.715598 29377 tablet_bootstrap.cc:492] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Bootstrap starting.
I20260808 07:01:49.715996 29379 tablet_bootstrap.cc:492] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Bootstrap starting.
I20260808 07:01:49.716336 29380 tablet_bootstrap.cc:492] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Bootstrap starting.
I20260808 07:01:49.716380 29377 tablet_bootstrap.cc:654] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.716815 29379 tablet_bootstrap.cc:654] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.716802 29377 log.cc:824] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:49.716879 29380 tablet_bootstrap.cc:654] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.717118 29379 log.cc:824] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:49.717195 29380 log.cc:824] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:49.717587 29377 tablet_bootstrap.cc:492] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: No bootstrap required, opened a new log
I20260808 07:01:49.717661 29377 ts_tablet_manager.cc:1397] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:01:49.717809 29379 tablet_bootstrap.cc:492] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: No bootstrap required, opened a new log
I20260808 07:01:49.717875 29379 ts_tablet_manager.cc:1397] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:01:49.717921 29380 tablet_bootstrap.cc:492] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: No bootstrap required, opened a new log
I20260808 07:01:49.717989 29380 ts_tablet_manager.cc:1397] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:01:49.719611 29380 raft_consensus.cc:348] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.719751 29380 raft_consensus.cc:374] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.719643 29377 raft_consensus.cc:348] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.719784 29380 raft_consensus.cc:729] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c278637840e43e0bc084c5e010562c1, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.719708 29379 raft_consensus.cc:348] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.719813 29377 raft_consensus.cc:374] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.719822 29379 raft_consensus.cc:374] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.719852 29379 raft_consensus.cc:729] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a571dc629d462cae0e40b558d10732, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.719851 29377 raft_consensus.cc:729] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8597168ba4aa4d62b9897a23d365f252, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.719923 29380 consensus_queue.cc:260] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.719955 29379 consensus_queue.cc:260] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.719955 29377 consensus_queue.cc:260] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.720189 29380 ts_tablet_manager.cc:1428] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:49.720207 28895 heartbeater.cc:503] Master 127.26.23.190:33027 was elected leader, sending a full tablet report...
I20260808 07:01:49.720213 29377 ts_tablet_manager.cc:1428] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:01:49.720213 29379 ts_tablet_manager.cc:1428] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:01:49.720337 29112 heartbeater.cc:503] Master 127.26.23.190:33027 was elected leader, sending a full tablet report...
I20260808 07:01:49.720378 29333 heartbeater.cc:503] Master 127.26.23.190:33027 was elected leader, sending a full tablet report...
W20260808 07:01:49.767392 29113 tablet.cc:2369] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:01:49.768896 29387 raft_consensus.cc:482] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:49.769006 29387 raft_consensus.cc:504] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.769361 29387 leader_election.cc:288] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309), 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211)
I20260808 07:01:49.773175 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.769656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:51923 (local address 127.26.23.130:41211)
0808 07:01:49.769702 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.769704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.769713 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:49.769742 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.769742 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.769751 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.769800 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.769979 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.770787 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.772246 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.772817 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.772882 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.772891 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.773065 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.773103 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:01:49.773176 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.769677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:43117 (local address 127.26.23.129:41309)
0808 07:01:49.769719 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.769721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.769845 (+ 124us) server_negotiation.cc:407] Connection header received
0808 07:01:49.769877 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.769878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.769886 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.769927 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.770064 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.770787 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.772246 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.772807 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.772882 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.772891 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.773065 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.773115 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:01:49.773195 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.769561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:41211 (local address 127.26.23.131:51923)
0808 07:01:49.769617 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.769629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.769672 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.769829 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.769830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.769831 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.769907 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.769909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.770874 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.770875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.772163 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.772167 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.772884 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.772885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.773004 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.773007 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.773054 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.773098 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":75}
I20260808 07:01:49.773204 29389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.769563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41309 (local address 127.26.23.131:43117)
0808 07:01:49.769769 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.769776 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.769828 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.769944 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.769944 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.769946 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.770009 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.770011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.770874 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.770875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.772176 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.772178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.772884 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.772885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.772994 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.772998 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.773054 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.773098 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":63,"thread_start_us":117,"threads_started":1}
I20260808 07:01:49.773597 29046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8764e26b014aca8a0729fb0fab541d" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8597168ba4aa4d62b9897a23d365f252" is_pre_election: true
I20260808 07:01:49.773638 28824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8764e26b014aca8a0729fb0fab541d" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c278637840e43e0bc084c5e010562c1" is_pre_election: true
I20260808 07:01:49.773777 29046 raft_consensus.cc:2454] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 0.
I20260808 07:01:49.773779 28824 raft_consensus.cc:2454] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 0.
I20260808 07:01:49.774019 29155 leader_election.cc:302] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8597168ba4aa4d62b9897a23d365f252, a2a571dc629d462cae0e40b558d10732; no voters:
I20260808 07:01:49.774180 29387 raft_consensus.cc:2781] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:49.774241 29387 raft_consensus.cc:482] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:49.774271 29387 raft_consensus.cc:3037] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.775110 29387 raft_consensus.cc:504] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.775228 29387 leader_election.cc:288] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 election: Requested vote from peers 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309), 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211)
I20260808 07:01:49.775388 29046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8764e26b014aca8a0729fb0fab541d" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8597168ba4aa4d62b9897a23d365f252"
I20260808 07:01:49.775447 28824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8764e26b014aca8a0729fb0fab541d" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c278637840e43e0bc084c5e010562c1"
I20260808 07:01:49.775465 29046 raft_consensus.cc:3037] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.775533 28824 raft_consensus.cc:3037] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.776189 29046 raft_consensus.cc:2454] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 1.
I20260808 07:01:49.776279 28824 raft_consensus.cc:2454] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 1.
I20260808 07:01:49.776351 29155 leader_election.cc:302] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8597168ba4aa4d62b9897a23d365f252, a2a571dc629d462cae0e40b558d10732; no voters:
I20260808 07:01:49.776430 29387 raft_consensus.cc:2781] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:49.776566 29387 raft_consensus.cc:686] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 1 LEADER]: Becoming Leader. State: Replica: a2a571dc629d462cae0e40b558d10732, State: Running, Role: LEADER
I20260808 07:01:49.776638 29387 consensus_queue.cc:237] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.777410 28559 catalog_manager.cc:5495] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a571dc629d462cae0e40b558d10732 (127.26.23.131). New cstate: current_term: 1 leader_uuid: "a2a571dc629d462cae0e40b558d10732" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } health_report { overall_health: HEALTHY } } }
I20260808 07:01:49.784042 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.781591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.26.23.131:44441)
0808 07:01:49.781676 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.781677 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.781685 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:01:49.781711 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.781712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.781727 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.781781 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:49.781915 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.782381 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.783122 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.783327 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.783381 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.783576 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:49.783674 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:49.783740 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.783792 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.783811 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 07:01:49.785565 29046 raft_consensus.cc:1261] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Refusing update from remote peer a2a571dc629d462cae0e40b558d10732: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:49.785588 28824 raft_consensus.cc:1261] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Refusing update from remote peer a2a571dc629d462cae0e40b558d10732: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:49.785892 29387 consensus_queue.cc:1035] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:49.786029 29390 consensus_queue.cc:1035] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:49.791308 28563 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:49.791394 28563 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:49.792091 28563 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: Sending DeleteTablet for 3 replicas of tablet ae8764e26b014aca8a0729fb0fab541d
I20260808 07:01:49.792452 29229 tablet_service.cc:1514] Processing DeleteTablet for tablet ae8764e26b014aca8a0729fb0fab541d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:49 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:49744
I20260808 07:01:49.792440 28792 tablet_service.cc:1514] Processing DeleteTablet for tablet ae8764e26b014aca8a0729fb0fab541d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:49 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:33200
I20260808 07:01:49.792456 29014 tablet_service.cc:1514] Processing DeleteTablet for tablet ae8764e26b014aca8a0729fb0fab541d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:49 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:50896
I20260808 07:01:49.792806 29410 tablet_replica.cc:330] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: stopping tablet replica
I20260808 07:01:49.792912 29410 raft_consensus.cc:2229] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:49.792918 28563 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:01:49.793022 29410 raft_consensus.cc:2258] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 07:01:49.793079 28563 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:49.793459 29410 ts_tablet_manager.cc:1905] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:49.794513 29014 tablet_service.cc:1467] Processing CreateTablet for tablet 88e2ce4babdc410397ee4843fdef15f9 (DEFAULT_TABLE table=test-table [id=42c35c0a29e048a5967016a9d37c2682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:49.794544 29229 tablet_service.cc:1467] Processing CreateTablet for tablet 88e2ce4babdc410397ee4843fdef15f9 (DEFAULT_TABLE table=test-table [id=42c35c0a29e048a5967016a9d37c2682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:49.794513 28792 tablet_service.cc:1467] Processing CreateTablet for tablet 88e2ce4babdc410397ee4843fdef15f9 (DEFAULT_TABLE table=test-table [id=42c35c0a29e048a5967016a9d37c2682]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:49.794657 29014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e2ce4babdc410397ee4843fdef15f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.794672 28792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e2ce4babdc410397ee4843fdef15f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.794675 29229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88e2ce4babdc410397ee4843fdef15f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.795693 29410 ts_tablet_manager.cc:1918] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:01:49.795758 29410 log.cc:1196] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/ae8764e26b014aca8a0729fb0fab541d
I20260808 07:01:49.795933 29380 tablet_bootstrap.cc:492] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Bootstrap starting.
I20260808 07:01:49.795989 29379 tablet_bootstrap.cc:492] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Bootstrap starting.
I20260808 07:01:49.796165 29410 ts_tablet_manager.cc:1939] T ae8764e26b014aca8a0729fb0fab541d P 8597168ba4aa4d62b9897a23d365f252: Deleting consensus metadata
I20260808 07:01:49.796389 29379 tablet_bootstrap.cc:654] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.796607 29380 tablet_bootstrap.cc:654] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.796931 29377 tablet_bootstrap.cc:492] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Bootstrap starting.
I20260808 07:01:49.796911 28541 catalog_manager.cc:4841] TS 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211): tablet ae8764e26b014aca8a0729fb0fab541d (table test-table [id=84b9eee50b03496e84482e125b67fd9b]) successfully deleted
I20260808 07:01:49.797041 29379 tablet_bootstrap.cc:492] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: No bootstrap required, opened a new log
I20260808 07:01:49.797086 29379 ts_tablet_manager.cc:1397] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:49.797238 29379 raft_consensus.cc:348] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.797300 29379 raft_consensus.cc:374] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.797302 29377 tablet_bootstrap.cc:654] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.797318 29379 raft_consensus.cc:729] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a571dc629d462cae0e40b558d10732, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.797362 29379 consensus_queue.cc:260] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.797451 29379 ts_tablet_manager.cc:1428] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.797837 29377 tablet_bootstrap.cc:492] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: No bootstrap required, opened a new log
I20260808 07:01:49.797885 29377 ts_tablet_manager.cc:1397] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:01:49.798022 29377 raft_consensus.cc:348] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.798092 29377 raft_consensus.cc:374] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.798120 29377 raft_consensus.cc:729] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8597168ba4aa4d62b9897a23d365f252, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.798199 29377 consensus_queue.cc:260] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.798292 29377 ts_tablet_manager.cc:1428] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:49.798453 29413 tablet_replica.cc:330] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: stopping tablet replica
I20260808 07:01:49.798542 29380 tablet_bootstrap.cc:492] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: No bootstrap required, opened a new log
I20260808 07:01:49.798568 29413 raft_consensus.cc:2229] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:49.798589 29380 ts_tablet_manager.cc:1397] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:01:49.798687 29413 raft_consensus.cc:2258] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:49.798743 29380 raft_consensus.cc:348] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.798806 29380 raft_consensus.cc:374] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.798826 29380 raft_consensus.cc:729] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c278637840e43e0bc084c5e010562c1, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.798856 29411 tablet_replica.cc:330] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: stopping tablet replica
I20260808 07:01:49.798866 29380 consensus_queue.cc:260] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.798954 29380 ts_tablet_manager.cc:1428] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:49.798956 29411 raft_consensus.cc:2229] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:01:49.799052 29411 raft_consensus.cc:2258] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:49.799325 29413 ts_tablet_manager.cc:1905] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:49.799407 29411 ts_tablet_manager.cc:1905] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:49.800872 29413 ts_tablet_manager.cc:1918] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:01:49.800872 29411 ts_tablet_manager.cc:1918] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:01:49.800948 29411 log.cc:1196] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/ae8764e26b014aca8a0729fb0fab541d
I20260808 07:01:49.800948 29413 log.cc:1196] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/ae8764e26b014aca8a0729fb0fab541d
I20260808 07:01:49.801194 29413 ts_tablet_manager.cc:1939] T ae8764e26b014aca8a0729fb0fab541d P 9c278637840e43e0bc084c5e010562c1: Deleting consensus metadata
I20260808 07:01:49.801194 29411 ts_tablet_manager.cc:1939] T ae8764e26b014aca8a0729fb0fab541d P a2a571dc629d462cae0e40b558d10732: Deleting consensus metadata
I20260808 07:01:49.801540 28535 catalog_manager.cc:4841] TS 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309): tablet ae8764e26b014aca8a0729fb0fab541d (table test-table [id=84b9eee50b03496e84482e125b67fd9b]) successfully deleted
I20260808 07:01:49.801573 28544 catalog_manager.cc:4841] TS a2a571dc629d462cae0e40b558d10732 (127.26.23.131:44441): tablet ae8764e26b014aca8a0729fb0fab541d (table test-table [id=84b9eee50b03496e84482e125b67fd9b]) successfully deleted
W20260808 07:01:49.862870 28897 tablet.cc:2369] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:01:49.890861 29404 raft_consensus.cc:482] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:49.890962 29404 raft_consensus.cc:504] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.891146 29404 leader_election.cc:288] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309), 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211)
I20260808 07:01:49.891331 28824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e2ce4babdc410397ee4843fdef15f9" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c278637840e43e0bc084c5e010562c1" is_pre_election: true
I20260808 07:01:49.891353 29046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e2ce4babdc410397ee4843fdef15f9" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8597168ba4aa4d62b9897a23d365f252" is_pre_election: true
I20260808 07:01:49.891438 29046 raft_consensus.cc:2454] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 0.
I20260808 07:01:49.891438 28824 raft_consensus.cc:2454] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 0.
I20260808 07:01:49.891595 29152 leader_election.cc:302] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c278637840e43e0bc084c5e010562c1, a2a571dc629d462cae0e40b558d10732; no voters:
I20260808 07:01:49.891731 29404 raft_consensus.cc:2781] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:49.891784 29404 raft_consensus.cc:482] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:49.891803 29404 raft_consensus.cc:3037] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.892515 29404 raft_consensus.cc:504] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.892653 29404 leader_election.cc:288] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 election: Requested vote from peers 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309), 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211)
I20260808 07:01:49.892812 29046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e2ce4babdc410397ee4843fdef15f9" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8597168ba4aa4d62b9897a23d365f252"
I20260808 07:01:49.892838 28824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88e2ce4babdc410397ee4843fdef15f9" candidate_uuid: "a2a571dc629d462cae0e40b558d10732" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c278637840e43e0bc084c5e010562c1"
I20260808 07:01:49.892891 29046 raft_consensus.cc:3037] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.892920 28824 raft_consensus.cc:3037] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.893558 29046 raft_consensus.cc:2454] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 1.
I20260808 07:01:49.893723 28824 raft_consensus.cc:2454] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a571dc629d462cae0e40b558d10732 in term 1.
I20260808 07:01:49.893833 29155 leader_election.cc:302] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8597168ba4aa4d62b9897a23d365f252, a2a571dc629d462cae0e40b558d10732; no voters:
I20260808 07:01:49.893923 29404 raft_consensus.cc:2781] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:49.893975 29404 raft_consensus.cc:686] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 1 LEADER]: Becoming Leader. State: Replica: a2a571dc629d462cae0e40b558d10732, State: Running, Role: LEADER
I20260808 07:01:49.894030 29404 consensus_queue.cc:237] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.894629 28563 catalog_manager.cc:5495] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a571dc629d462cae0e40b558d10732 (127.26.23.131). New cstate: current_term: 1 leader_uuid: "a2a571dc629d462cae0e40b558d10732" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } health_report { overall_health: HEALTHY } } }
W20260808 07:01:49.922217 29335 tablet.cc:2369] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 07:01:49 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:49.941005 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.934830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.26.23.190:33027)
0808 07:01:49.934902 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.934904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.934977 (+ 73us) server_negotiation.cc:407] Connection header received
0808 07:01:49.935026 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.935027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.935036 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.935085 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:49.935505 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.936013 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.936700 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.936896 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.936959 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.938902 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:49.938903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:49.938904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:49.938910 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:49.940074 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.940395 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.940396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.940396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.940443 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:49.940571 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:49.940571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:49.940571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:49.940664 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:49.940707 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.940818 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.940922 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":41}
I20260808 07:01:49.941015 29425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.934770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33027 (local address 127.0.0.1:43492)
0808 07:01:49.934912 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.934922 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.934987 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.935098 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.935099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.935396 (+ 297us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:49.935447 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.935449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.936070 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.936070 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.936618 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.936620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.936960 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.936961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.936997 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.937475 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:49.937480 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:49.938816 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:49.940142 (+ 1326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.940149 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.940151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.940339 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.940485 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:49.940486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:49.940486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:49.940533 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:49.940705 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:49.940710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:49.940750 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.940797 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.940880 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260808 07:01:49.942915 28563 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:43492:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:01:49.943106 28563 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:49.944444 28792 tablet_service.cc:1467] Processing CreateTablet for tablet 533660c0bcff43e198a1e1a78bd2d38a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=077ca15bb7ce4a818fad301977d78d7e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:01:49.944465 29229 tablet_service.cc:1467] Processing CreateTablet for tablet 533660c0bcff43e198a1e1a78bd2d38a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=077ca15bb7ce4a818fad301977d78d7e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:01:49.944592 28792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 533660c0bcff43e198a1e1a78bd2d38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.944613 29229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 533660c0bcff43e198a1e1a78bd2d38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.945789 29380 tablet_bootstrap.cc:492] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: Bootstrap starting.
I20260808 07:01:49.945902 29379 tablet_bootstrap.cc:492] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: Bootstrap starting.
I20260808 07:01:49.945883 29014 tablet_service.cc:1467] Processing CreateTablet for tablet 533660c0bcff43e198a1e1a78bd2d38a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=077ca15bb7ce4a818fad301977d78d7e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:01:49.946017 29014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 533660c0bcff43e198a1e1a78bd2d38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:49.946219 29379 tablet_bootstrap.cc:654] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.946219 29380 tablet_bootstrap.cc:654] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.946786 29379 tablet_bootstrap.cc:492] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: No bootstrap required, opened a new log
I20260808 07:01:49.946834 29379 ts_tablet_manager.cc:1397] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:01:49.946943 29379 raft_consensus.cc:348] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.946978 29380 tablet_bootstrap.cc:492] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: No bootstrap required, opened a new log
I20260808 07:01:49.946996 29379 raft_consensus.cc:374] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.947009 29379 raft_consensus.cc:729] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a571dc629d462cae0e40b558d10732, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.947022 29380 ts_tablet_manager.cc:1397] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 07:01:49.947044 29379 consensus_queue.cc:260] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.947125 29379 ts_tablet_manager.cc:1428] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.947176 29380 raft_consensus.cc:348] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.947249 29380 raft_consensus.cc:374] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.947269 29380 raft_consensus.cc:729] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c278637840e43e0bc084c5e010562c1, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.947304 29380 consensus_queue.cc:260] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.947288 29404 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.947360 29404 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:49.947383 29380 ts_tablet_manager.cc:1428] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:49.947444 29377 tablet_bootstrap.cc:492] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: Bootstrap starting.
I20260808 07:01:49.947652 29386 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.947731 29386 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:49.947865 29377 tablet_bootstrap.cc:654] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:49.948530 29377 tablet_bootstrap.cc:492] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: No bootstrap required, opened a new log
I20260808 07:01:49.948571 29377 ts_tablet_manager.cc:1397] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:49.948693 29377 raft_consensus.cc:348] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.948748 29377 raft_consensus.cc:374] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:49.948761 29377 raft_consensus.cc:729] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8597168ba4aa4d62b9897a23d365f252, State: Initialized, Role: FOLLOWER
I20260808 07:01:49.948796 29377 consensus_queue.cc:260] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.948877 29377 ts_tablet_manager.cc:1428] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:49.948945 29388 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.949043 29388 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:49.972734 29388 raft_consensus.cc:482] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:49.972815 29388 raft_consensus.cc:504] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.973095 29388 leader_election.cc:288] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309), a2a571dc629d462cae0e40b558d10732 (127.26.23.131:44441)
I20260808 07:01:49.976158 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.973286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:45853 (local address 127.26.23.129:41309)
0808 07:01:49.973329 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.973332 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.973342 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:01:49.973412 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.973413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.973423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.973482 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.973628 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.974294 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.975295 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.975831 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.975903 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.975914 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.976078 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.976106 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:01:49.976191 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.973244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41309 (local address 127.26.23.130:45853)
0808 07:01:49.973295 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.973308 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.973349 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.973489 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.973489 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.973491 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.973559 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.973560 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.974369 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.974371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.975198 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.975201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.975914 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.975915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.976010 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.976015 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.976065 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.976115 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:01:49.976624 28824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "533660c0bcff43e198a1e1a78bd2d38a" candidate_uuid: "8597168ba4aa4d62b9897a23d365f252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c278637840e43e0bc084c5e010562c1" is_pre_election: true
I20260808 07:01:49.976711 28824 raft_consensus.cc:2454] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8597168ba4aa4d62b9897a23d365f252 in term 0.
I20260808 07:01:49.976743 29433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.973248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:44441 (local address 127.26.23.130:41443)
0808 07:01:49.973466 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.973477 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.973534 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.973665 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.973666 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.973668 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:49.973740 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.973742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.974443 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.974444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.975859 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.975862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.976496 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.976498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.976575 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.976578 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.976625 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.976665 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":42,"thread_start_us":120,"threads_started":1}
I20260808 07:01:49.976749 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.973306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:41443 (local address 127.26.23.131:44441)
0808 07:01:49.973353 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.973354 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.973539 (+ 185us) server_negotiation.cc:407] Connection header received
0808 07:01:49.973569 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.973570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.973583 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.973656 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:49.973798 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.974374 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.975944 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.976420 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.976475 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.976481 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.976653 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.976694 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:01:49.976900 28931 leader_election.cc:302] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8597168ba4aa4d62b9897a23d365f252, 9c278637840e43e0bc084c5e010562c1; no voters:
I20260808 07:01:49.977022 29388 raft_consensus.cc:2781] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:49.977058 29388 raft_consensus.cc:482] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:49.977077 29388 raft_consensus.cc:3037] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.977128 29256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "533660c0bcff43e198a1e1a78bd2d38a" candidate_uuid: "8597168ba4aa4d62b9897a23d365f252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a571dc629d462cae0e40b558d10732" is_pre_election: true
I20260808 07:01:49.977253 29256 raft_consensus.cc:2454] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8597168ba4aa4d62b9897a23d365f252 in term 0.
I20260808 07:01:49.977806 29388 raft_consensus.cc:504] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.977921 29388 leader_election.cc:288] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [CANDIDATE]: Term 1 election: Requested vote from peers 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309), a2a571dc629d462cae0e40b558d10732 (127.26.23.131:44441)
I20260808 07:01:49.978101 28824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "533660c0bcff43e198a1e1a78bd2d38a" candidate_uuid: "8597168ba4aa4d62b9897a23d365f252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c278637840e43e0bc084c5e010562c1"
I20260808 07:01:49.978101 29256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "533660c0bcff43e198a1e1a78bd2d38a" candidate_uuid: "8597168ba4aa4d62b9897a23d365f252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a571dc629d462cae0e40b558d10732"
I20260808 07:01:49.978197 28824 raft_consensus.cc:3037] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.978197 29256 raft_consensus.cc:3037] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:49.978871 28824 raft_consensus.cc:2454] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8597168ba4aa4d62b9897a23d365f252 in term 1.
I20260808 07:01:49.978880 29256 raft_consensus.cc:2454] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8597168ba4aa4d62b9897a23d365f252 in term 1.
I20260808 07:01:49.979040 28935 leader_election.cc:302] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8597168ba4aa4d62b9897a23d365f252, a2a571dc629d462cae0e40b558d10732; no voters:
I20260808 07:01:49.979132 29388 raft_consensus.cc:2781] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:49.979264 29388 raft_consensus.cc:686] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [term 1 LEADER]: Becoming Leader. State: Replica: 8597168ba4aa4d62b9897a23d365f252, State: Running, Role: LEADER
I20260808 07:01:49.979318 29388 consensus_queue.cc:237] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } }
I20260808 07:01:49.979681 29434 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: TxnStatusTablet state changed. Reason: New leader 8597168ba4aa4d62b9897a23d365f252. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.979771 29434 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:01:49.979943 29437 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:01:49.980044 29437 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:01:49.979998 28559 catalog_manager.cc:5495] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } health_report { overall_health: UNKNOWN } } }
I20260808 07:01:49.994573 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.992197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50908 (local address 127.26.23.130:41211)
0808 07:01:49.992236 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:49.992239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:49.992309 (+ 70us) server_negotiation.cc:407] Connection header received
0808 07:01:49.992396 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:49.992397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:49.992415 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:49.992474 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:49.992591 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.993058 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.993813 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.993997 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.994049 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.994264 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:49.994372 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:49.994438 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:49.994486 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 07:01:49.994506 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:01:49.994593 29425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:49.992143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:41211 (local address 127.0.0.1:50908)
0808 07:01:49.992264 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:49.992276 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:49.992332 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:49.992479 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:49.992480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:49.992481 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:49.992530 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.992533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.993134 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.993135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.993721 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:49.993723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:49.994057 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:49.994058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:49.994139 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:49.994188 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:49.994430 (+ 242us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:49.994441 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 07:01:49.994483 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 07:01:49.994529 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 07:01:49.995724 28824 raft_consensus.cc:1261] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Refusing update from remote peer 8597168ba4aa4d62b9897a23d365f252: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:49.995786 29256 raft_consensus.cc:1261] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Refusing update from remote peer 8597168ba4aa4d62b9897a23d365f252: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:49.995963 29434 consensus_queue.cc:1035] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:49.996065 29388 consensus_queue.cc:1035] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:49.996631 29386 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: TxnStatusTablet state changed. Reason: New leader 8597168ba4aa4d62b9897a23d365f252. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.996721 29386 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:49.996688 29404 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: TxnStatusTablet state changed. Reason: New leader 8597168ba4aa4d62b9897a23d365f252. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.996755 29404 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:49.997294 29434 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.997364 29434 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:01:49.997390 29396 mvcc.cc:205] Tried to move back new op lower bound from 7316162600940728320 to 7316162600875708416. Current Snapshot: MvccSnapshot[applied={T|T < 7316162600940728320}]
I20260808 07:01:49.997474 29404 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.997529 29404 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P a2a571dc629d462cae0e40b558d10732: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:49.997808 29397 mvcc.cc:205] Tried to move back new op lower bound from 7316162600940728320 to 7316162600875708416. Current Snapshot: MvccSnapshot[applied={T|T < 7316162600940728320 or (T in {7316162600940728320})}]
I20260808 07:01:49.998237 29434 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.998313 29434 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 8597168ba4aa4d62b9897a23d365f252: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:01:49.998589 29399 mvcc.cc:205] Tried to move back new op lower bound from 7316162600940728320 to 7316162600875708416. Current Snapshot: MvccSnapshot[applied={T|T < 7316162600940728320}]
I20260808 07:01:49.998803 29386 tablet_replica.cc:439] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8597168ba4aa4d62b9897a23d365f252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 } } peers { permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 } } peers { permanent_uuid: "a2a571dc629d462cae0e40b558d10732" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44441 } } }
I20260808 07:01:49.998880 29386 tablet_replica.cc:442] T 533660c0bcff43e198a1e1a78bd2d38a P 9c278637840e43e0bc084c5e010562c1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:50.003510 29375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:50.001191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:55815 (local address 127.26.23.130:41211)
0808 07:01:50.001222 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:50.001224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:50.001253 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:01:50.001310 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:50.001311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:50.001317 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:50.001359 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:50.001458 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.001901 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.002971 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.003145 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.003191 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:50.003349 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:50.003371 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:50.003399 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:50.003452 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:01:50.003467 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 07:01:50.003561 29343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:50.001145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:41211 (local address 127.26.23.131:55815)
0808 07:01:50.001212 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:50.001223 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:50.001266 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:50.001364 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:50.001364 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:50.001365 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:50.001407 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:50.001408 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.001964 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.001965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:50.002898 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:50.002901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.003204 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.003205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:50.003268 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:50.003284 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:50.003411 (+ 127us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:50.003412 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:01:50.003445 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 07:01:50.003487 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 07:01:50.005400 28824 raft_consensus.cc:1261] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Refusing update from remote peer a2a571dc629d462cae0e40b558d10732: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:50.005475 29046 raft_consensus.cc:1261] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Refusing update from remote peer a2a571dc629d462cae0e40b558d10732: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:50.005589 29387 consensus_queue.cc:1035] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c278637840e43e0bc084c5e010562c1" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:50.005774 29387 consensus_queue.cc:1035] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8597168ba4aa4d62b9897a23d365f252" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 41211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:50.016716 29121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:50.010473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:44441 (local address 127.26.23.130:38273)
0808 07:01:50.010523 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:50.010533 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:50.010568 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:50.010712 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:50.010713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:50.010715 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:50.010775 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:50.010777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.011648 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.011649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:50.012332 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:50.012335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.016278 (+ 3943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.016279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:50.016354 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:50.016371 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:50.016546 (+ 175us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:50.016548 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:01:50.016601 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:01:50.016645 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 07:01:50.016716 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:50.010563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:38273 (local address 127.26.23.131:44441)
0808 07:01:50.010606 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:50.010608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:50.010615 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:01:50.010633 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:50.010634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:50.010643 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:50.010692 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:50.010855 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.011578 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.012410 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.012637 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.012689 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:50.016451 (+ 3762us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:50.016500 (+ 49us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:50.016544 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:50.016604 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 07:01:50.016625 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:01:50.027194 28559 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:50.027284 28559 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:50.027848 28559 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9761cdfdccf643e5b40088746d5f155a: Sending DeleteTablet for 3 replicas of tablet 88e2ce4babdc410397ee4843fdef15f9
I20260808 07:01:50.028075 29014 tablet_service.cc:1514] Processing DeleteTablet for tablet 88e2ce4babdc410397ee4843fdef15f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:50 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:50896
I20260808 07:01:50.028085 29229 tablet_service.cc:1514] Processing DeleteTablet for tablet 88e2ce4babdc410397ee4843fdef15f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:50 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:49744
I20260808 07:01:50.028191 29410 tablet_replica.cc:330] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: stopping tablet replica
I20260808 07:01:50.028193 28792 tablet_service.cc:1514] Processing DeleteTablet for tablet 88e2ce4babdc410397ee4843fdef15f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:50 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:33200
I20260808 07:01:50.028249 29410 raft_consensus.cc:2229] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:50.028285 29410 raft_consensus.cc:2258] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:50.028280 29413 tablet_replica.cc:330] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: stopping tablet replica
I20260808 07:01:50.028332 29413 raft_consensus.cc:2229] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:50.028342 29411 tablet_replica.cc:330] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: stopping tablet replica
I20260808 07:01:50.028362 29413 raft_consensus.cc:2258] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:50.028396 29411 raft_consensus.cc:2229] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:01:50.028443 29411 raft_consensus.cc:2258] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:50.028868 29413 ts_tablet_manager.cc:1905] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:50.030506 29413 ts_tablet_manager.cc:1918] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:50.030558 29413 log.cc:1196] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/88e2ce4babdc410397ee4843fdef15f9
I20260808 07:01:50.030755 29413 ts_tablet_manager.cc:1939] T 88e2ce4babdc410397ee4843fdef15f9 P 9c278637840e43e0bc084c5e010562c1: Deleting consensus metadata
I20260808 07:01:50.031009 29411 ts_tablet_manager.cc:1905] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:50.031111 28535 catalog_manager.cc:4841] TS 9c278637840e43e0bc084c5e010562c1 (127.26.23.129:41309): tablet 88e2ce4babdc410397ee4843fdef15f9 (table test-table [id=42c35c0a29e048a5967016a9d37c2682]) successfully deleted
I20260808 07:01:50.032496 29411 ts_tablet_manager.cc:1918] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:50.032545 29411 log.cc:1196] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/88e2ce4babdc410397ee4843fdef15f9
I20260808 07:01:50.032738 29411 ts_tablet_manager.cc:1939] T 88e2ce4babdc410397ee4843fdef15f9 P a2a571dc629d462cae0e40b558d10732: Deleting consensus metadata
I20260808 07:01:50.033018 28544 catalog_manager.cc:4841] TS a2a571dc629d462cae0e40b558d10732 (127.26.23.131:44441): tablet 88e2ce4babdc410397ee4843fdef15f9 (table test-table [id=42c35c0a29e048a5967016a9d37c2682]) successfully deleted
I20260808 07:01:50.033205 29410 ts_tablet_manager.cc:1905] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:50.034307 29410 ts_tablet_manager.cc:1918] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:50.034358 29410 log.cc:1196] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/88e2ce4babdc410397ee4843fdef15f9
I20260808 07:01:50.034560 29410 ts_tablet_manager.cc:1939] T 88e2ce4babdc410397ee4843fdef15f9 P 8597168ba4aa4d62b9897a23d365f252: Deleting consensus metadata
I20260808 07:01:50.034859 28541 catalog_manager.cc:4841] TS 8597168ba4aa4d62b9897a23d365f252 (127.26.23.130:41211): tablet 88e2ce4babdc410397ee4843fdef15f9 (table test-table [id=42c35c0a29e048a5967016a9d37c2682]) successfully deleted
Aug 08 07:01:50 dist-test-slave-zj8q krb5kdc[28488](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172509, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:01:50.042584 29373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:50.034467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33208 (local address 127.26.23.129:41309)
0808 07:01:50.034513 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:50.034515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:50.034633 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:01:50.034719 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:50.034720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:50.034733 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:50.034796 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:50.035447 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.035915 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.036914 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.037084 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.037133 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:50.039964 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:50.039974 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:50.039975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:50.039981 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:50.041450 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:50.041774 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:50.041777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:50.041777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:50.041843 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:50.042006 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:50.042007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:50.042007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:50.042148 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:50.042335 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:50.042413 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:01:50.042492 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 07:01:50.042819 28889 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33208
I20260808 07:01:50.049494 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:50.043675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.26.23.190:33027)
0808 07:01:50.043720 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:50.043722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:50.043731 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:50.043780 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:50.043781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:50.043789 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:50.043830 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:50.044375 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.044874 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.045876 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:50.046062 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:50.046121 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:50.047288 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:50.047289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:50.047289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:50.047295 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:50.048535 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:50.048885 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:50.048885 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:50.048885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:50.048930 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:50.049098 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:50.049099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:50.049099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:50.049198 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:50.049264 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:50.049377 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:01:50.049435 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:01:50.049782 28559 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43496
I20260808 07:01:50.050323 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28687
I20260808 07:01:50.072463 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28908
I20260808 07:01:50.085722 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29125
I20260808 07:01:50.098456 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28512
2026-08-08T07:01:50Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2321 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:50 dist-test-slave-zj8q krb5kdc[29467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:50 dist-test-slave-zj8q krb5kdc[29467](info): set up 2 sockets
Aug 08 07:01:50 dist-test-slave-zj8q krb5kdc[29467](info): commencing operation
krb5kdc: starting...
W20260808 07:01:51.233809 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:01:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:01:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:01:51.348388 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:41919
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:43439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:41919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:51.429158 29488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:51.429373 29488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:51.429397 29488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:51.430573 29488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:01:51.430619 29488 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:01:51.430632 29488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:51.430644 29488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:51.430663 29488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:01:51.430688 29488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:01:51.432224 29488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:41919
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:41919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:51.432474 29488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:51.432698 29488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:51.437522 29494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:51.437513 29497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:51.437516 29493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:51.437868 29488 server_base.cc:1034] running on GCE node
I20260808 07:01:51.438117 29488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:51.438416 29488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:51.439604 29488 hybrid_clock.cc:648] HybridClock initialized: now 1786172511439619 us; error 62 us; skew 500 ppm
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:51.442096 29488 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:01:51.442589 29488 webserver.cc:460] Webserver started at http://127.26.23.190:37237/ using document root <none> and password file <none>
I20260808 07:01:51.442802 29488 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:51.442850 29488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:51.442973 29488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:51.444000 29488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "3a50714ee2204439bd1f136abb04552b"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "29f4463e1a0bcfaacbec61ca617577d8"
server_key_iv: "27bb1fde67155211a5c54012b5175393"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.444352 29488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "3a50714ee2204439bd1f136abb04552b"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "29f4463e1a0bcfaacbec61ca617577d8"
server_key_iv: "27bb1fde67155211a5c54012b5175393"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.445623 29488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:01:51.446372 29511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.446514 29488 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:51.446647 29488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "3a50714ee2204439bd1f136abb04552b"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "29f4463e1a0bcfaacbec61ca617577d8"
server_key_iv: "27bb1fde67155211a5c54012b5175393"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.446709 29488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:51.454375 29488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:51.456073 29488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:51.456205 29488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:51.460700 29488 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:41919
I20260808 07:01:51.460748 29606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:41919 every 8 connection(s)
I20260808 07:01:51.461050 29488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:01:51.461681 29608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:51.462760 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29488
I20260808 07:01:51.462850 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:01:51.463027 26718 external_mini_cluster.cc:1428] Setting key 03de6c143021e580e1c64be04b5f5df2
I20260808 07:01:51.464296 29608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Bootstrap starting.
I20260808 07:01:51.464984 29608 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:51.465282 29608 log.cc:824] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:51.466002 29608 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: No bootstrap required, opened a new log
I20260808 07:01:51.468396 29608 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a50714ee2204439bd1f136abb04552b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41919 } }
I20260808 07:01:51.468580 29608 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:51.468636 29608 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a50714ee2204439bd1f136abb04552b, State: Initialized, Role: FOLLOWER
I20260808 07:01:51.468767 29608 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a50714ee2204439bd1f136abb04552b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41919 } }
I20260808 07:01:51.468850 29608 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:01:51.468889 29608 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:01:51.468938 29608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:51.469547 29608 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a50714ee2204439bd1f136abb04552b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41919 } }
I20260808 07:01:51.469646 29608 leader_election.cc:302] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a50714ee2204439bd1f136abb04552b; no voters:
I20260808 07:01:51.469802 29608 leader_election.cc:288] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:51.469830 29621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:51.469939 29621 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [term 1 LEADER]: Becoming Leader. State: Replica: 3a50714ee2204439bd1f136abb04552b, State: Running, Role: LEADER
I20260808 07:01:51.470019 29621 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a50714ee2204439bd1f136abb04552b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41919 } }
I20260808 07:01:51.470047 29608 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:01:51.470544 29621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a50714ee2204439bd1f136abb04552b. Latest consensus state: current_term: 1 leader_uuid: "3a50714ee2204439bd1f136abb04552b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a50714ee2204439bd1f136abb04552b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41919 } } }
I20260808 07:01:51.470738 29621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:51.470584 29624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a50714ee2204439bd1f136abb04552b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a50714ee2204439bd1f136abb04552b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41919 } } }
I20260808 07:01:51.470961 29624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:51.471347 29629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:01:51.471998 29629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:01:51.473483 29629 catalog_manager.cc:1347] Generated new cluster ID: 91f3a4bf51064971a2d1303254ddb9f8
I20260808 07:01:51.473536 29629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:01:51.475132 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.463610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36720 (local address 127.26.23.190:41919)
0808 07:01:51.463777 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.463788 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.463812 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:01:51.464244 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.464250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.464296 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.464431 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.465165 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.466340 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.467366 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.467765 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.467838 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.470386 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.470390 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.470391 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.470403 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.472646 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.473064 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.473068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.473069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.473209 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.474207 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.474208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.474208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.474499 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.474652 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.474805 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.474932 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260808 07:01:51.484419 29629 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:01:51.484921 29629 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:01:51.488333 29629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Generated new TSK 0
I20260808 07:01:51.488480 29629 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:01:51.520418 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41919
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:43439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:51.612510 29661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:51.612717 29661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:51.612741 29661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:51.613849 29661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:51.613891 29661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:51.613910 29661 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:01:51.613932 29661 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:01:51.613956 29661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:01:51.615448 29661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:41919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:51.615679 29661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:51.615885 29661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:51.620949 29669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:51.620924 29668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:51.620952 29661 server_base.cc:1034] running on GCE node
W20260808 07:01:51.620918 29671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:51.621325 29661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:51.621615 29661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:51.622788 29661 hybrid_clock.cc:648] HybridClock initialized: now 1786172511622772 us; error 28 us; skew 500 ppm
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:51.625311 29661 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:01:51.625797 29661 webserver.cc:460] Webserver started at http://127.26.23.129:34409/ using document root <none> and password file <none>
I20260808 07:01:51.626049 29661 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:51.626098 29661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:51.626238 29661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:51.627269 29661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "6de7d585a7c14c728ab9ef42879a071e"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "b6e9c30d21578dfbe4c91382592b48db"
server_key_iv: "ab1f82754ddde3b72a7060553632a465"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.627610 29661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "6de7d585a7c14c728ab9ef42879a071e"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "b6e9c30d21578dfbe4c91382592b48db"
server_key_iv: "ab1f82754ddde3b72a7060553632a465"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.628873 29661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:01:51.629518 29680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.629676 29661 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:51.629765 29661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "6de7d585a7c14c728ab9ef42879a071e"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "b6e9c30d21578dfbe4c91382592b48db"
server_key_iv: "ab1f82754ddde3b72a7060553632a465"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.629822 29661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:51.647279 29661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:51.649273 29661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:51.649389 29661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:51.649861 29661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:51.649900 29661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.649921 29661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:51.649932 29661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.656368 29661 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:39177
I20260808 07:01:51.656469 29866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:39177 every 8 connection(s)
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:51.656771 29661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:01:51.659404 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.650289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:60911 (local address 127.26.23.190:41919)
0808 07:01:51.650343 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.650345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.650566 (+ 221us) server_negotiation.cc:407] Connection header received
0808 07:01:51.651088 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.651090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.651103 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.651153 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.651943 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.652706 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.654182 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.654516 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.654583 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.656993 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.656995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.656995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.657003 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.658176 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.658529 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.658530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.658530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.658587 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.658801 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.658801 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.658802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.658914 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.658968 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.659216 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.659312 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:01:51.659559 29690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.650297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.26.23.129:60911)
0808 07:01:51.650447 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:51.650487 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:51.650979 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:51.651222 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:51.651226 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:51.651560 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:51.651844 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.651852 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.652803 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.652805 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.654061 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.654065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.654602 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.654603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.654751 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.655244 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:51.655255 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:51.656911 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:51.658239 (+ 1328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.658246 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.658248 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.658461 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.658640 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.658641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.658641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.658745 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.658967 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:51.658973 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:51.659103 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 07:01:51.659188 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:01:51.659334 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260808 07:01:51.659994 29867 heartbeater.cc:347] Connected to a master server at 127.26.23.190:41919
I20260808 07:01:51.660073 29867 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:51.660238 29867 heartbeater.cc:511] Master 127.26.23.190:41919 requested a full tablet report, sending...
I20260808 07:01:51.660792 29533 ts_manager.cc:194] Registered new tserver with Master: 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177)
I20260808 07:01:51.661654 29533 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:60911
I20260808 07:01:51.665741 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.660979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36423 (local address 127.26.23.190:41919)
0808 07:01:51.661017 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.661019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.661122 (+ 103us) server_negotiation.cc:407] Connection header received
0808 07:01:51.661187 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.661188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.661196 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.661243 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.661556 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.662181 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.662927 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.663123 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.663173 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.663965 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.663965 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.663965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.663970 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.664948 (+ 978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.665213 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.665214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.665214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.665257 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.665375 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.665375 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.665376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.665464 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.665504 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.665624 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.665685 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:01:51.665742 29875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.660931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.26.23.129:36423)
0808 07:01:51.661065 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:51.661075 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:51.661136 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:51.661263 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:51.661263 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:51.661437 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:51.661500 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.661502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.662280 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.662281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.662859 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.662861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.663187 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.663188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.663267 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.663614 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:51.663618 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:51.663905 (+ 287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:51.665010 (+ 1105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.665011 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.665011 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.665161 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.665298 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.665298 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.665298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.665343 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.665500 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:51.665501 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:51.665545 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:01:51.665598 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:01:51.665667 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260808 07:01:51.666062 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29661
I20260808 07:01:51.666167 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:01:51.666353 26718 external_mini_cluster.cc:1428] Setting key 9cc3e9270b7da7d1cee339a8730162f1
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:01:51.692415 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41919
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:43439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:51.772794 29879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:51.772989 29879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:51.773011 29879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:51.774106 29879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:51.774165 29879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:51.774195 29879 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:01:51.774219 29879 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:01:51.774258 29879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:01:51.775678 29879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:41919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:51.775892 29879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:51.776096 29879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:51.780952 29888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:51.780959 29892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:51.780959 29894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:51.781172 29879 server_base.cc:1034] running on GCE node
I20260808 07:01:51.781395 29879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:51.781622 29879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:51.782765 29879 hybrid_clock.cc:648] HybridClock initialized: now 1786172511782750 us; error 31 us; skew 500 ppm
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:51.785123 29879 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:01:51.785573 29879 webserver.cc:460] Webserver started at http://127.26.23.130:41495/ using document root <none> and password file <none>
I20260808 07:01:51.785768 29879 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:51.785815 29879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:51.785938 29879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:51.786988 29879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "b32c18953fd5493c828b956484f2bcc9"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "0826c74f97e9270be8c6ae017a71d9b5"
server_key_iv: "903db33ba682d361a90d4f2f8bc0688b"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.787322 29879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "b32c18953fd5493c828b956484f2bcc9"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "0826c74f97e9270be8c6ae017a71d9b5"
server_key_iv: "903db33ba682d361a90d4f2f8bc0688b"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.788530 29879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:01:51.789175 29905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.789314 29879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:51.789398 29879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "b32c18953fd5493c828b956484f2bcc9"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "0826c74f97e9270be8c6ae017a71d9b5"
server_key_iv: "903db33ba682d361a90d4f2f8bc0688b"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.789464 29879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:51.801819 29879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:51.803512 29879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:51.803646 29879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:51.804098 29879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:51.804136 29879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.804163 29879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:51.804180 29879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:51.811094 29879 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:34263
I20260808 07:01:51.811175 30086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:34263 every 8 connection(s)
I20260808 07:01:51.811447 29879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:01:51.813266 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.804510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60381 (local address 127.26.23.190:41919)
0808 07:01:51.804570 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.804573 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.804779 (+ 206us) server_negotiation.cc:407] Connection header received
0808 07:01:51.805399 (+ 620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.805400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.805412 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.805468 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.806349 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.806977 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.807966 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.808171 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.808224 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.810626 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.810628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.810628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.810636 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.812011 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.812397 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.812399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.812399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.812457 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.812675 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.812676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.812676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.812791 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.812847 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.813090 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.813178 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:01:51.813414 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.804470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.26.23.130:60381)
0808 07:01:51.804636 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:51.804683 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:51.805292 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:51.805575 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:51.805579 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:51.805941 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:51.806247 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.806254 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.807063 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.807064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.807874 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.807877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.808241 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.808242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.808364 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.808791 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:51.808800 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:51.810540 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:51.812081 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.812088 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.812090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.812332 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.812508 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.812509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.812509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.812612 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.812845 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:51.812851 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:51.812979 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 07:01:51.813063 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:01:51.813210 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260808 07:01:51.813859 30087 heartbeater.cc:347] Connected to a master server at 127.26.23.190:41919
I20260808 07:01:51.813937 30087 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:51.814105 30087 heartbeater.cc:511] Master 127.26.23.190:41919 requested a full tablet report, sending...
I20260808 07:01:51.814517 29535 ts_manager.cc:194] Registered new tserver with Master: b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263)
I20260808 07:01:51.814972 29535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:60381
I20260808 07:01:51.817113 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29879
I20260808 07:01:51.817217 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:01:51.817405 26718 external_mini_cluster.cc:1428] Setting key 220ced65bdc30d21c2ec842b505bf39f
I20260808 07:01:51.820261 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.814828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:56289 (local address 127.26.23.190:41919)
0808 07:01:51.814861 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.814862 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.815205 (+ 343us) server_negotiation.cc:407] Connection header received
0808 07:01:51.815259 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.815259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.815267 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.815306 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.815647 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.816108 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.816750 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.816932 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.816992 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.817979 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.817981 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.817981 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.817987 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.819223 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.819524 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.819524 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.819525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.819579 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.819769 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.819769 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.819770 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.819946 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.819998 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.820148 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.820204 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:01:51.820313 30099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.814783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.26.23.130:56289)
0808 07:01:51.815133 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:51.815144 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:51.815207 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:51.815311 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:51.815312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:51.815499 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:51.815569 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.815571 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.816184 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.816185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.816660 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.816661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.816999 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.817000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.817075 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.817551 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:51.817557 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:51.817913 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:51.819297 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.819298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.819298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.819462 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.819631 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.819632 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.819632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.819685 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.820002 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:51.820003 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:51.820054 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 07:01:51.820124 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 07:01:51.820222 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":62,"threads_started":1}
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:01:51.842744 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41919
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:43439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:51.924208 30102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:51.924397 30102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:51.924420 30102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:51.925475 30102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:51.925508 30102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:51.925545 30102 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 07:01:51.925562 30102 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:01:51.925578 30102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:01:51.926970 30102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:41919
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:51.927161 30102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:51.927335 30102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:51.932154 30115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:51.932281 30102 server_base.cc:1034] running on GCE node
W20260808 07:01:51.932149 30122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:51.932155 30114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:51.932591 30102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:51.932859 30102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:51.934010 30102 hybrid_clock.cc:648] HybridClock initialized: now 1786172511933988 us; error 39 us; skew 500 ppm
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:51.936439 30102 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:01:51.936877 30102 webserver.cc:460] Webserver started at http://127.26.23.131:44891/ using document root <none> and password file <none>
I20260808 07:01:51.937079 30102 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:51.937129 30102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:51.937249 30102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:51.938326 30102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "c019af530a714f528db7d7e5ab50acec"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "95e49ea1167b78f0d1a78f9f2ea8824f"
server_key_iv: "2fbf4235d0fb0f5b47c383a626796cfa"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.938659 30102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "c019af530a714f528db7d7e5ab50acec"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "95e49ea1167b78f0d1a78f9f2ea8824f"
server_key_iv: "2fbf4235d0fb0f5b47c383a626796cfa"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.939968 30102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:01:51.940608 30132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.940768 30102 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:51.940856 30102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "c019af530a714f528db7d7e5ab50acec"
format_stamp: "Formatted at 2026-08-08 07:01:51 on dist-test-slave-zj8q"
server_key: "95e49ea1167b78f0d1a78f9f2ea8824f"
server_key_iv: "2fbf4235d0fb0f5b47c383a626796cfa"
server_key_version: "encryptionkey@0"
I20260808 07:01:51.940913 30102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:51.959442 30102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:51.961481 30102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:51.961615 30102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:51.962132 30102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:51.962196 30102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:51.962226 30102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:51.962249 30102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:51.969269 30102 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:36627
I20260808 07:01:51.969585 30309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:36627 every 8 connection(s)
I20260808 07:01:51.969671 30102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:01:51.971177 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.962543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:54573 (local address 127.26.23.190:41919)
0808 07:01:51.962606 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.962608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.962789 (+ 181us) server_negotiation.cc:407] Connection header received
0808 07:01:51.963249 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.963250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.963264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.963332 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.963942 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.964443 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.965438 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.965683 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.965737 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.968469 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.968471 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.968471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.968479 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.969844 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.970336 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.970337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.970338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.970404 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.970610 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.970610 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.970611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.970712 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.970755 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.970993 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.971085 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:01:51.971354 30147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.962508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.26.23.131:54573)
0808 07:01:51.962664 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:51.962703 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:51.963155 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:51.963396 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:51.963399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:51.963654 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:51.963854 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.963858 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.964525 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.964526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.965354 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.965356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.965764 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.965765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.965909 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.966346 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:51.966363 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:51.968373 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:51.969964 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.969969 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.969972 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.970269 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.970463 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.970463 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.970464 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.970561 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.970762 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:51.970767 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:51.970892 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 07:01:51.970973 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:01:51.971123 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":92,"threads_started":1}
I20260808 07:01:51.971799 30311 heartbeater.cc:347] Connected to a master server at 127.26.23.190:41919
I20260808 07:01:51.971881 30311 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:51.972059 30311 heartbeater.cc:511] Master 127.26.23.190:41919 requested a full tablet report, sending...
I20260808 07:01:51.972854 29535 ts_manager.cc:194] Registered new tserver with Master: c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:51.973344 29535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:54573
I20260808 07:01:51.977695 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30102
I20260808 07:01:51.977779 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:01:51.977931 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.972846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:52287 (local address 127.26.23.190:41919)
0808 07:01:51.972880 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.972882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.972977 (+ 95us) server_negotiation.cc:407] Connection header received
0808 07:01:51.973037 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.973038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.973045 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.973088 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.973400 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.974092 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.974807 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.974989 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.975057 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.975797 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.975798 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.975798 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.975804 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:51.976838 (+ 1034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.977114 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.977115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.977115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.977155 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:51.977282 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:51.977282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:51.977282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:51.977363 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:51.977403 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:51.977794 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 07:01:51.977868 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:01:51.977941 30322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.972787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.26.23.131:52287)
0808 07:01:51.972920 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:51.972931 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:51.972990 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:51.973094 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:51.973094 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:51.973267 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:51.973331 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.973333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.974234 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.974235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.974734 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:51.974736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.975052 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.975052 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:51.975104 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.975431 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:51.975435 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:51.975723 (+ 288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:51.976908 (+ 1185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.976908 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.976909 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.977061 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.977197 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:51.977197 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:51.977197 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:51.977242 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:51.977579 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:51.977580 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:51.977665 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 07:01:51.977752 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:01:51.977846 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":67,"threads_started":1}
I20260808 07:01:51.977965 26718 external_mini_cluster.cc:1428] Setting key bfceb48b3c5152dafb8da5b50482a865
I20260808 07:01:51.978786 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:01:51 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:52.001070 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:51.994978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36724 (local address 127.26.23.190:41919)
0808 07:01:51.995021 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:51.995022 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:51.995031 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:01:51.995070 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:51.995071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:51.995079 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:51.995150 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:51.995663 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.996157 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.996823 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:51.996992 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:51.997032 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:51.998999 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:51.999000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:51.999001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:51.999007 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:52.000239 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:52.000517 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:52.000518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:52.000518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:52.000568 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:52.000717 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:52.000718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:52.000718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:52.000805 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:52.000870 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.000948 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.001003 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:01:52.002566 29535 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:01:52.004109 29535 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:52.010370 30340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.006557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:34263 (local address 127.0.0.1:34468)
0808 07:01:52.006732 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.006772 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.006836 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.007095 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.007098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.007101 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.007188 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.007190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.008157 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.008157 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.009286 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.009288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.010066 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.010067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.010145 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.010179 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.010241 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.010293 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":70,"threads_started":1}
I20260808 07:01:52.010386 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.006700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34468 (local address 127.26.23.130:34263)
0808 07:01:52.006873 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.006877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.006887 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:01:52.006926 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.006927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.006945 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.007013 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.007274 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.008087 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.009376 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.009993 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.010062 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.010120 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.010255 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.010293 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":70,"threads_started":1}
I20260808 07:01:52.010825 30346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.006772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:39177 (local address 127.0.0.1:53882)
0808 07:01:52.006995 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.007006 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.007058 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.007503 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.007504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.007506 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.007539 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.007540 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.008709 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.008711 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.009576 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.009578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.010562 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.010563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.010650 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.010656 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.010711 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.010749 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":30,"thread_start_us":77,"threads_started":1}
I20260808 07:01:52.010876 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.006982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.26.23.129:39177)
0808 07:01:52.007224 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.007228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.007239 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:01:52.007396 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.007406 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.007430 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.007505 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.007606 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.008634 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.009648 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.010404 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.010474 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.010526 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.010745 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.010786 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":119,"threads_started":1}
I20260808 07:01:52.011116 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.006681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44420 (local address 127.26.23.131:36627)
0808 07:01:52.006879 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.006885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.007033 (+ 148us) server_negotiation.cc:407] Connection header received
0808 07:01:52.007086 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.007088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.007103 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.007169 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.007342 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.008467 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.009714 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.010416 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.010474 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.010525 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.010977 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.011016 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":87,"threads_started":1}
I20260808 07:01:52.010910 30339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.006571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:36627 (local address 127.0.0.1:44420)
0808 07:01:52.006925 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.006933 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.006975 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.007234 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.007235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.007237 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.007276 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.007277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.008561 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.008562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.009642 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.009644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.010564 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.010564 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.010650 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.010655 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.010808 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.010840 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":22,"thread_start_us":76,"threads_started":1}
I20260808 07:01:52.011507 29988 tablet_service.cc:1467] Processing CreateTablet for tablet 945054e4819a46dc93a08cfe4bfe03e9 (DEFAULT_TABLE table=test-table [id=2ac24fb542b943799d7e7cbc1faff9fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:52.011952 29988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945054e4819a46dc93a08cfe4bfe03e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.011890 29758 tablet_service.cc:1467] Processing CreateTablet for tablet 945054e4819a46dc93a08cfe4bfe03e9 (DEFAULT_TABLE table=test-table [id=2ac24fb542b943799d7e7cbc1faff9fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:52.012225 29758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945054e4819a46dc93a08cfe4bfe03e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.015827 30349 tablet_bootstrap.cc:492] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Bootstrap starting.
I20260808 07:01:52.015890 30348 tablet_bootstrap.cc:492] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Bootstrap starting.
I20260808 07:01:52.016054 30201 tablet_service.cc:1467] Processing CreateTablet for tablet 945054e4819a46dc93a08cfe4bfe03e9 (DEFAULT_TABLE table=test-table [id=2ac24fb542b943799d7e7cbc1faff9fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:52.016377 30201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 945054e4819a46dc93a08cfe4bfe03e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.017726 30348 tablet_bootstrap.cc:654] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.018069 30348 log.cc:824] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:52.018348 30349 tablet_bootstrap.cc:654] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.018754 30349 log.cc:824] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:52.018940 30348 tablet_bootstrap.cc:492] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: No bootstrap required, opened a new log
I20260808 07:01:52.019059 30348 ts_tablet_manager.cc:1397] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:01:52.019312 30353 tablet_bootstrap.cc:492] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Bootstrap starting.
I20260808 07:01:52.020211 30353 tablet_bootstrap.cc:654] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.020512 30353 log.cc:824] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:52.020658 30348 raft_consensus.cc:348] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.020875 30348 raft_consensus.cc:374] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.020932 30348 raft_consensus.cc:729] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.021050 30348 consensus_queue.cc:260] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.021363 30348 ts_tablet_manager.cc:1428] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:52.021370 30087 heartbeater.cc:503] Master 127.26.23.190:41919 was elected leader, sending a full tablet report...
I20260808 07:01:52.021430 30353 tablet_bootstrap.cc:492] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: No bootstrap required, opened a new log
I20260808 07:01:52.021484 30353 ts_tablet_manager.cc:1397] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:52.022682 30349 tablet_bootstrap.cc:492] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: No bootstrap required, opened a new log
I20260808 07:01:52.022737 30349 ts_tablet_manager.cc:1397] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260808 07:01:52.024010 30349 raft_consensus.cc:348] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.024142 30349 raft_consensus.cc:374] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.024163 30349 raft_consensus.cc:729] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de7d585a7c14c728ab9ef42879a071e, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.024240 30349 consensus_queue.cc:260] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.024434 30349 ts_tablet_manager.cc:1428] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:01:52.024489 29867 heartbeater.cc:503] Master 127.26.23.190:41919 was elected leader, sending a full tablet report...
I20260808 07:01:52.025444 30353 raft_consensus.cc:348] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.025579 30353 raft_consensus.cc:374] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.025600 30353 raft_consensus.cc:729] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c019af530a714f528db7d7e5ab50acec, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.025700 30353 consensus_queue.cc:260] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.025923 30353 ts_tablet_manager.cc:1428] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 07:01:52.025959 30311 heartbeater.cc:503] Master 127.26.23.190:41919 was elected leader, sending a full tablet report...
W20260808 07:01:52.062011 30088 tablet.cc:2369] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:01:52.103190 30360 raft_consensus.cc:482] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:52.103318 30360 raft_consensus.cc:504] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.103734 30360 leader_election.cc:288] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263), 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177)
I20260808 07:01:52.107633 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.104239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:48513 (local address 127.26.23.129:39177)
0808 07:01:52.104296 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.104298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.104354 (+ 56us) server_negotiation.cc:407] Connection header received
0808 07:01:52.104397 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.104398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.104405 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.104457 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.104612 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.105309 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.106684 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.107255 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.107332 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.107341 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.107514 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.107561 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:01:52.107633 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.104012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:57605 (local address 127.26.23.130:34263)
0808 07:01:52.104081 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.104084 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.104096 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:01:52.104125 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.104126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.104136 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.104196 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.104457 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.105230 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.106684 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.107255 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.107332 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.107341 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.107513 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.107558 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:01:52.107653 30361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.104101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:39177 (local address 127.26.23.131:48513)
0808 07:01:52.104281 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.104292 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.104348 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.104474 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.104475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.104476 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.104524 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.104525 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.105377 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.105378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.106584 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.106587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.107343 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.107344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.107435 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.107439 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.107496 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.107544 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":6,"thread_start_us":122,"threads_started":1}
I20260808 07:01:52.107661 30147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.103938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:34263 (local address 127.26.23.131:57605)
0808 07:01:52.103997 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.104010 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.104062 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.104295 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.104297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.104299 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.104381 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.104383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.105321 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.105322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.106588 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.106589 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.107342 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.107343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.107434 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.107439 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.107496 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.107544 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":13}
I20260808 07:01:52.108052 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945054e4819a46dc93a08cfe4bfe03e9" candidate_uuid: "c019af530a714f528db7d7e5ab50acec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e" is_pre_election: true
I20260808 07:01:52.108215 29790 raft_consensus.cc:2454] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c019af530a714f528db7d7e5ab50acec in term 0.
I20260808 07:01:52.108176 30016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945054e4819a46dc93a08cfe4bfe03e9" candidate_uuid: "c019af530a714f528db7d7e5ab50acec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b32c18953fd5493c828b956484f2bcc9" is_pre_election: true
I20260808 07:01:52.108323 30016 raft_consensus.cc:2454] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c019af530a714f528db7d7e5ab50acec in term 0.
I20260808 07:01:52.108439 30140 leader_election.cc:302] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de7d585a7c14c728ab9ef42879a071e, c019af530a714f528db7d7e5ab50acec; no voters:
I20260808 07:01:52.108709 30360 raft_consensus.cc:2781] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:52.108769 30360 raft_consensus.cc:482] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:52.108793 30360 raft_consensus.cc:3037] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.109496 30360 raft_consensus.cc:504] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.109622 30360 leader_election.cc:288] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [CANDIDATE]: Term 1 election: Requested vote from peers b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263), 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177)
I20260808 07:01:52.109822 30016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945054e4819a46dc93a08cfe4bfe03e9" candidate_uuid: "c019af530a714f528db7d7e5ab50acec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b32c18953fd5493c828b956484f2bcc9"
I20260808 07:01:52.109871 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "945054e4819a46dc93a08cfe4bfe03e9" candidate_uuid: "c019af530a714f528db7d7e5ab50acec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e"
I20260808 07:01:52.109896 30016 raft_consensus.cc:3037] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.109958 29790 raft_consensus.cc:3037] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.110641 30016 raft_consensus.cc:2454] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c019af530a714f528db7d7e5ab50acec in term 1.
I20260808 07:01:52.110742 29790 raft_consensus.cc:2454] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c019af530a714f528db7d7e5ab50acec in term 1.
I20260808 07:01:52.110863 30140 leader_election.cc:302] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32c18953fd5493c828b956484f2bcc9, c019af530a714f528db7d7e5ab50acec; no voters:
I20260808 07:01:52.110975 30360 raft_consensus.cc:2781] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:52.111141 30360 raft_consensus.cc:686] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 1 LEADER]: Becoming Leader. State: Replica: c019af530a714f528db7d7e5ab50acec, State: Running, Role: LEADER
I20260808 07:01:52.111235 30360 consensus_queue.cc:237] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.112025 29535 catalog_manager.cc:5495] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec reported cstate change: term changed from 0 to 1, leader changed from <none> to c019af530a714f528db7d7e5ab50acec (127.26.23.131). New cstate: current_term: 1 leader_uuid: "c019af530a714f528db7d7e5ab50acec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } health_report { overall_health: HEALTHY } } }
Aug 08 07:01:52 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172511, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:52.153218 30373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.146743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41919 (local address 127.0.0.1:36738)
0808 07:01:52.146908 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.146918 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.146987 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.147102 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.147102 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.147417 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:52.147462 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.147465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.148092 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.148093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.148636 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.148638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.148939 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.148939 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.149018 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.149480 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:52.149485 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:52.150837 (+ 1352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:52.152230 (+ 1393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:52.152238 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:52.152240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:52.152419 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:52.152582 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:52.152583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:52.152583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:52.152651 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:52.152851 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:52.152859 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:52.152905 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.152965 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.153081 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260808 07:01:52.153231 29615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.146803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36738 (local address 127.26.23.190:41919)
0808 07:01:52.146860 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.146862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.146983 (+ 121us) server_negotiation.cc:407] Connection header received
0808 07:01:52.147044 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.147044 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.147054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.147093 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:52.147543 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.148022 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.148709 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.148883 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.148935 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.150915 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:52.150916 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:52.150916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:52.150923 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:52.152159 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:52.152480 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:52.152481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:52.152482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:52.152531 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:52.152700 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:52.152701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:52.152702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:52.152800 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:52.152854 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.152994 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.153137 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":32}
I20260808 07:01:52.155251 29535 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:36738:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:01:52.155440 29535 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:52.156914 29758 tablet_service.cc:1467] Processing CreateTablet for tablet fd5c5f1442114e7c9584440f6097f487 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a98818aa9f394985b37b43983725caa2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:01:52.156952 29988 tablet_service.cc:1467] Processing CreateTablet for tablet fd5c5f1442114e7c9584440f6097f487 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a98818aa9f394985b37b43983725caa2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:01:52.157012 30201 tablet_service.cc:1467] Processing CreateTablet for tablet fd5c5f1442114e7c9584440f6097f487 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a98818aa9f394985b37b43983725caa2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:01:52.157104 29988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5c5f1442114e7c9584440f6097f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.157104 29758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5c5f1442114e7c9584440f6097f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.157173 30201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd5c5f1442114e7c9584440f6097f487. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 07:01:52.157588 29868 tablet.cc:2369] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:01:52.158627 30349 tablet_bootstrap.cc:492] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: Bootstrap starting.
I20260808 07:01:52.158797 30353 tablet_bootstrap.cc:492] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: Bootstrap starting.
I20260808 07:01:52.159165 30353 tablet_bootstrap.cc:654] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.159257 30349 tablet_bootstrap.cc:654] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.159556 30348 tablet_bootstrap.cc:492] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: Bootstrap starting.
I20260808 07:01:52.159893 30349 tablet_bootstrap.cc:492] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: No bootstrap required, opened a new log
I20260808 07:01:52.159933 30353 tablet_bootstrap.cc:492] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: No bootstrap required, opened a new log
I20260808 07:01:52.159935 30349 ts_tablet_manager.cc:1397] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:52.159968 30353 ts_tablet_manager.cc:1397] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:52.160115 30348 tablet_bootstrap.cc:654] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.160079 30349 raft_consensus.cc:348] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.160099 30353 raft_consensus.cc:348] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.160157 30349 raft_consensus.cc:374] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.160162 30353 raft_consensus.cc:374] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.160179 30349 raft_consensus.cc:729] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de7d585a7c14c728ab9ef42879a071e, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.160182 30353 raft_consensus.cc:729] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c019af530a714f528db7d7e5ab50acec, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.160228 30349 consensus_queue.cc:260] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.160228 30353 consensus_queue.cc:260] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.160311 30353 ts_tablet_manager.cc:1428] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:52.160311 30349 ts_tablet_manager.cc:1428] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:52.160370 30360 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.160413 30359 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.160460 30360 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.160487 30359 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.160771 30348 tablet_bootstrap.cc:492] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: No bootstrap required, opened a new log
I20260808 07:01:52.160825 30348 ts_tablet_manager.cc:1397] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:52.160971 30348 raft_consensus.cc:348] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.161046 30348 raft_consensus.cc:374] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.161062 30348 raft_consensus.cc:729] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.161099 30348 consensus_queue.cc:260] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.161206 30348 ts_tablet_manager.cc:1428] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:52.161267 30357 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.161361 30357 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.215556 30357 raft_consensus.cc:482] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:52.215667 30357 raft_consensus.cc:504] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.216041 30357 leader_election.cc:288] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:52.219060 29921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.216204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:39177 (local address 127.26.23.130:42865)
0808 07:01:52.216270 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.216281 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.216329 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.216463 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.216464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.216466 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.216555 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.216557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.217434 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.217435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.218259 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.218261 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.218819 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.218821 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.218905 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.218910 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.218961 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.219004 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:01:52.219097 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.216269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:42865 (local address 127.26.23.129:39177)
0808 07:01:52.216327 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.216329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.216341 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:01:52.216376 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.216377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.216387 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.216453 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.216632 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.217362 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.218346 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.218743 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.218805 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.218814 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.218968 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.219005 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:01:52.219233 30378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.216233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:36627 (local address 127.26.23.130:51241)
0808 07:01:52.216420 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.216430 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.216485 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.216678 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.216679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.216681 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:01:52.216763 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.216765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.217526 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.217527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.218383 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.218386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.218979 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.218980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.219047 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.219051 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.219108 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.219146 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
I20260808 07:01:52.219246 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.216344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:51241 (local address 127.26.23.131:36627)
0808 07:01:52.216384 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.216387 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.216487 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:01:52.216554 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.216555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.216564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.216617 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:01:52.216827 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.217451 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.218463 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.218872 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.218943 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.218951 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.219135 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.219178 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:01:52.219527 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5c5f1442114e7c9584440f6097f487" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e" is_pre_election: true
I20260808 07:01:52.219645 29790 raft_consensus.cc:2454] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:52.219600 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5c5f1442114e7c9584440f6097f487" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec" is_pre_election: true
I20260808 07:01:52.219703 30238 raft_consensus.cc:2454] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:52.219862 29912 leader_election.cc:302] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de7d585a7c14c728ab9ef42879a071e, b32c18953fd5493c828b956484f2bcc9; no voters:
I20260808 07:01:52.220012 30357 raft_consensus.cc:2781] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:52.220055 30357 raft_consensus.cc:482] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:52.220085 30357 raft_consensus.cc:3037] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:01:52.220156 30313 tablet.cc:2369] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:01:52.220796 30357 raft_consensus.cc:504] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.220921 30357 leader_election.cc:288] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:52.221088 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5c5f1442114e7c9584440f6097f487" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e"
I20260808 07:01:52.221100 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd5c5f1442114e7c9584440f6097f487" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec"
I20260808 07:01:52.221169 29790 raft_consensus.cc:3037] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.221169 30238 raft_consensus.cc:3037] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.221786 30238 raft_consensus.cc:2454] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:52.221881 29790 raft_consensus.cc:2454] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:52.221969 29908 leader_election.cc:302] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32c18953fd5493c828b956484f2bcc9, c019af530a714f528db7d7e5ab50acec; no voters:
I20260808 07:01:52.222069 30357 raft_consensus.cc:2781] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:52.222245 30357 raft_consensus.cc:686] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Running, Role: LEADER
I20260808 07:01:52.222339 30357 consensus_queue.cc:237] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.222787 30379 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: TxnStatusTablet state changed. Reason: New leader b32c18953fd5493c828b956484f2bcc9. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.222878 30379 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:01:52.223125 29533 catalog_manager.cc:5495] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b32c18953fd5493c828b956484f2bcc9 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } health_report { overall_health: UNKNOWN } } }
I20260808 07:01:52.223392 30383 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:01:52.223500 30383 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:01:52.236936 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.234313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34472 (local address 127.26.23.130:34263)
0808 07:01:52.234354 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.234356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.234401 (+ 45us) server_negotiation.cc:407] Connection header received
0808 07:01:52.234504 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.234505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.234524 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.234588 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:52.234706 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.235177 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.236254 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.236427 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.236473 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.236649 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.236741 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.236795 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.236852 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.236867 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:01:52.236977 30373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.234280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:34263 (local address 127.0.0.1:34472)
0808 07:01:52.234359 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.234369 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.234421 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.234599 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.234601 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.234602 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:52.234654 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.234657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.235237 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.235237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.236179 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.236182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.236485 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.236486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.236550 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.236567 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.236792 (+ 225us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.236798 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.236847 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.236895 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 07:01:52.238758 30238 raft_consensus.cc:1261] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:52.238797 29790 raft_consensus.cc:1261] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:52.239037 30357 consensus_queue.cc:1035] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:52.239181 30379 consensus_queue.cc:1035] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:52.240320 30360 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: TxnStatusTablet state changed. Reason: New leader b32c18953fd5493c828b956484f2bcc9. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.240409 30360 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.240437 30359 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: TxnStatusTablet state changed. Reason: New leader b32c18953fd5493c828b956484f2bcc9. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.240513 30359 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.241238 30357 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.241317 30357 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:01:52.241420 30357 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.241466 30357 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P b32c18953fd5493c828b956484f2bcc9: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:01:52.241782 30360 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.241858 30360 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P c019af530a714f528db7d7e5ab50acec: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.242030 30387 mvcc.cc:205] Tried to move back new op lower bound from 7316162610127572992 to 7316162610063192064. Current Snapshot: MvccSnapshot[applied={T|T < 7316162610127572992 or (T in {7316162610127572992})}]
I20260808 07:01:52.242146 30359 tablet_replica.cc:439] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } } }
I20260808 07:01:52.242235 30359 tablet_replica.cc:442] T fd5c5f1442114e7c9584440f6097f487 P 6de7d585a7c14c728ab9ef42879a071e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:01:52.242995 30390 mvcc.cc:205] Tried to move back new op lower bound from 7316162610127572992 to 7316162610063192064. Current Snapshot: MvccSnapshot[applied={T|T < 7316162610127572992}]
I20260808 07:01:52.243129 30388 mvcc.cc:205] Tried to move back new op lower bound from 7316162610127572992 to 7316162610063192064. Current Snapshot: MvccSnapshot[applied={T|T < 7316162610127572992}]
I20260808 07:01:52.246206 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.243825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44430 (local address 127.26.23.131:36627)
0808 07:01:52.243864 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.243866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.243960 (+ 94us) server_negotiation.cc:407] Connection header received
0808 07:01:52.244020 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.244020 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.244038 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.244096 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:52.244230 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.244687 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.245474 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.245686 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.245741 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.245895 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.245992 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.246059 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.246094 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.246112 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:01:52.251274 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.248742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:51131 (local address 127.26.23.130:34263)
0808 07:01:52.248779 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.248781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.248821 (+ 40us) server_negotiation.cc:407] Connection header received
0808 07:01:52.248892 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.248893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.248902 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.248948 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:52.249078 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.249532 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.250686 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.250863 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.250915 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.251096 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.251120 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.251153 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.251208 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.251223 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:01:52.251323 30322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.248677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:34263 (local address 127.26.23.131:51131)
0808 07:01:52.248769 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.248782 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.248836 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.248959 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.248960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.248961 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:52.249019 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.249020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.249643 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.249644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.250604 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.250607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.250926 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.250927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.250990 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.251006 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.251165 (+ 159us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.251167 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.251207 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.251249 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:01:52.253644 29790 raft_consensus.cc:1261] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Refusing update from remote peer c019af530a714f528db7d7e5ab50acec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:52.253748 30016 raft_consensus.cc:1261] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Refusing update from remote peer c019af530a714f528db7d7e5ab50acec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:52.253902 30363 consensus_queue.cc:1035] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:52.254230 30363 consensus_queue.cc:1035] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [LEADER]: Connected to new peer: Peer: permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:52.262835 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.260135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:55901 (local address 127.26.23.131:36627)
0808 07:01:52.260173 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.260175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.260230 (+ 55us) server_negotiation.cc:407] Connection header received
0808 07:01:52.260295 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.260295 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.260303 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.260345 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:52.260463 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.261003 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.262121 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.262364 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.262416 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.262641 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.262668 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.262701 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.262768 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.262786 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:01:52.262888 30099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.260099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:36627 (local address 127.26.23.130:55901)
0808 07:01:52.260188 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.260198 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.260244 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.260351 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.260352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.260353 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:52.260411 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.260413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.261074 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.261075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.262027 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.262030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.262437 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.262439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.262515 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.262531 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.262717 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.262719 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.262766 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.262811 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 07:01:52.271524 29533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:52.271633 29533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:52.272431 29533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Sending DeleteTablet for 3 replicas of tablet 945054e4819a46dc93a08cfe4bfe03e9
I20260808 07:01:52.272748 29988 tablet_service.cc:1514] Processing DeleteTablet for tablet 945054e4819a46dc93a08cfe4bfe03e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:52 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:34468
I20260808 07:01:52.272764 29758 tablet_service.cc:1514] Processing DeleteTablet for tablet 945054e4819a46dc93a08cfe4bfe03e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:52 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:53882
I20260808 07:01:52.273088 30201 tablet_service.cc:1514] Processing DeleteTablet for tablet 945054e4819a46dc93a08cfe4bfe03e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:52 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:44420
I20260808 07:01:52.273317 30418 tablet_replica.cc:330] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: stopping tablet replica
I20260808 07:01:52.273298 29533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:01:52.273440 29533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:52.273617 30418 raft_consensus.cc:2229] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:01:52.273773 30418 raft_consensus.cc:2258] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:52.274255 30418 ts_tablet_manager.cc:1905] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:52.274477 29988 tablet_service.cc:1467] Processing CreateTablet for tablet 2c135250c6dc4272aeda1ab334c43e3d (DEFAULT_TABLE table=test-table [id=b8573911ef2d4f86a9274135844fdb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:52.274611 29988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c135250c6dc4272aeda1ab334c43e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.275931 30348 tablet_bootstrap.cc:492] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Bootstrap starting.
I20260808 07:01:52.276279 30418 ts_tablet_manager.cc:1918] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:52.276362 30348 tablet_bootstrap.cc:654] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.276464 30418 log.cc:1196] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/945054e4819a46dc93a08cfe4bfe03e9
I20260808 07:01:52.276814 30418 ts_tablet_manager.cc:1939] T 945054e4819a46dc93a08cfe4bfe03e9 P c019af530a714f528db7d7e5ab50acec: Deleting consensus metadata
I20260808 07:01:52.276806 29758 tablet_service.cc:1467] Processing CreateTablet for tablet 2c135250c6dc4272aeda1ab334c43e3d (DEFAULT_TABLE table=test-table [id=b8573911ef2d4f86a9274135844fdb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:52.276914 29758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c135250c6dc4272aeda1ab334c43e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.278208 30349 tablet_bootstrap.cc:492] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Bootstrap starting.
I20260808 07:01:52.278409 29514 catalog_manager.cc:4841] TS c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627): tablet 945054e4819a46dc93a08cfe4bfe03e9 (table test-table [id=2ac24fb542b943799d7e7cbc1faff9fa]) successfully deleted
I20260808 07:01:52.278573 30349 tablet_bootstrap.cc:654] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.278707 30201 tablet_service.cc:1467] Processing CreateTablet for tablet 2c135250c6dc4272aeda1ab334c43e3d (DEFAULT_TABLE table=test-table [id=b8573911ef2d4f86a9274135844fdb6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:52.278805 30201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c135250c6dc4272aeda1ab334c43e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:52.279897 30353 tablet_bootstrap.cc:492] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Bootstrap starting.
I20260808 07:01:52.280282 30353 tablet_bootstrap.cc:654] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:52.280917 30353 tablet_bootstrap.cc:492] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: No bootstrap required, opened a new log
I20260808 07:01:52.280963 30353 ts_tablet_manager.cc:1397] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:52.281092 30353 raft_consensus.cc:348] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.281150 30353 raft_consensus.cc:374] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.281169 30353 raft_consensus.cc:729] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c019af530a714f528db7d7e5ab50acec, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.281210 30353 consensus_queue.cc:260] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.281292 30353 ts_tablet_manager.cc:1428] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:52.282253 30417 tablet_replica.cc:330] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: stopping tablet replica
I20260808 07:01:52.282263 30416 tablet_replica.cc:330] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: stopping tablet replica
I20260808 07:01:52.282372 30417 raft_consensus.cc:2229] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:52.282372 30416 raft_consensus.cc:2229] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:52.282430 30416 raft_consensus.cc:2258] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:52.282429 30417 raft_consensus.cc:2258] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:52.282511 30348 tablet_bootstrap.cc:492] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: No bootstrap required, opened a new log
I20260808 07:01:52.282557 30348 ts_tablet_manager.cc:1397] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260808 07:01:52.282691 30348 raft_consensus.cc:348] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.282754 30348 raft_consensus.cc:374] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.282773 30348 raft_consensus.cc:729] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.282819 30348 consensus_queue.cc:260] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.282902 30348 ts_tablet_manager.cc:1428] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:52.283108 30416 ts_tablet_manager.cc:1905] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:52.283149 30417 ts_tablet_manager.cc:1905] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:52.284651 30416 ts_tablet_manager.cc:1918] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:52.284735 30416 log.cc:1196] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/945054e4819a46dc93a08cfe4bfe03e9
I20260808 07:01:52.284689 30417 ts_tablet_manager.cc:1918] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:52.284888 30417 log.cc:1196] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/945054e4819a46dc93a08cfe4bfe03e9
I20260808 07:01:52.284982 30416 ts_tablet_manager.cc:1939] T 945054e4819a46dc93a08cfe4bfe03e9 P b32c18953fd5493c828b956484f2bcc9: Deleting consensus metadata
I20260808 07:01:52.285240 30417 ts_tablet_manager.cc:1939] T 945054e4819a46dc93a08cfe4bfe03e9 P 6de7d585a7c14c728ab9ef42879a071e: Deleting consensus metadata
I20260808 07:01:52.285368 29518 catalog_manager.cc:4841] TS b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263): tablet 945054e4819a46dc93a08cfe4bfe03e9 (table test-table [id=2ac24fb542b943799d7e7cbc1faff9fa]) successfully deleted
I20260808 07:01:52.285756 29518 catalog_manager.cc:4841] TS 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177): tablet 945054e4819a46dc93a08cfe4bfe03e9 (table test-table [id=2ac24fb542b943799d7e7cbc1faff9fa]) successfully deleted
I20260808 07:01:52.286067 30349 tablet_bootstrap.cc:492] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: No bootstrap required, opened a new log
I20260808 07:01:52.286113 30349 ts_tablet_manager.cc:1397] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260808 07:01:52.286266 30349 raft_consensus.cc:348] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.286329 30349 raft_consensus.cc:374] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:52.286347 30349 raft_consensus.cc:729] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de7d585a7c14c728ab9ef42879a071e, State: Initialized, Role: FOLLOWER
I20260808 07:01:52.286383 30349 consensus_queue.cc:260] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.286463 30349 ts_tablet_manager.cc:1428] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:52.379317 30406 raft_consensus.cc:482] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:52.379437 30406 raft_consensus.cc:504] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.379619 30406 leader_election.cc:288] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:52.379837 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c135250c6dc4272aeda1ab334c43e3d" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec" is_pre_election: true
I20260808 07:01:52.379946 30238 raft_consensus.cc:2454] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:52.379891 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c135250c6dc4272aeda1ab334c43e3d" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e" is_pre_election: true
I20260808 07:01:52.380043 29790 raft_consensus.cc:2454] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:52.380151 29908 leader_election.cc:302] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32c18953fd5493c828b956484f2bcc9, c019af530a714f528db7d7e5ab50acec; no voters:
I20260808 07:01:52.380262 30406 raft_consensus.cc:2781] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:52.380317 30406 raft_consensus.cc:482] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:52.380338 30406 raft_consensus.cc:3037] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.381029 30406 raft_consensus.cc:504] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.381152 30406 leader_election.cc:288] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:52.381388 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c135250c6dc4272aeda1ab334c43e3d" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e"
I20260808 07:01:52.381466 29790 raft_consensus.cc:3037] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.381430 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c135250c6dc4272aeda1ab334c43e3d" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec"
I20260808 07:01:52.381502 30238 raft_consensus.cc:3037] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:52.382083 29790 raft_consensus.cc:2454] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:52.382282 29912 leader_election.cc:302] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de7d585a7c14c728ab9ef42879a071e, b32c18953fd5493c828b956484f2bcc9; no voters:
I20260808 07:01:52.382282 30238 raft_consensus.cc:2454] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:52.382364 30406 raft_consensus.cc:2781] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:52.382406 30406 raft_consensus.cc:686] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Running, Role: LEADER
I20260808 07:01:52.382457 30406 consensus_queue.cc:237] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:52.383078 29533 catalog_manager.cc:5495] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b32c18953fd5493c828b956484f2bcc9 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } health_report { overall_health: UNKNOWN } } }
I20260808 07:01:52.402938 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.400821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34480 (local address 127.26.23.130:34263)
0808 07:01:52.400864 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.400866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.400876 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:01:52.400942 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.400943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.400952 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.401003 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:52.401106 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.401565 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.402345 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.402539 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.402593 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.402720 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.402755 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.402794 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.402846 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.402866 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:01:52.406769 30345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.404844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:45885 (local address 127.26.23.130:34263)
0808 07:01:52.404876 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:52.404878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:52.404885 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:01:52.404952 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:52.404953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:52.404961 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:52.404995 (+ 34us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:52.405082 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.405500 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.406202 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.406387 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.406438 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.406551 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.406578 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.406616 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:52.406665 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 07:01:52.406680 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:01:52.406771 30099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:52.404794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:34263 (local address 127.26.23.130:45885)
0808 07:01:52.404845 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:52.404855 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:52.404898 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:52.405005 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:52.405006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:52.405007 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:01:52.405041 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.405042 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.405577 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.405578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.406094 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:52.406096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:52.406443 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:52.406444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:52.406494 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:52.406498 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:01:52.406621 (+ 123us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:01:52.406623 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:01:52.406663 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 07:01:52.406703 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:01:52.408382 29790 raft_consensus.cc:1261] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:52.408429 30238 raft_consensus.cc:1261] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:52.408597 30406 consensus_queue.cc:1035] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:52.408684 30357 consensus_queue.cc:1035] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:01:52.412767 30387 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 07:01:53.930372 29535 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:53.930477 29535 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:53.931341 29535 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Sending DeleteTablet for 3 replicas of tablet 2c135250c6dc4272aeda1ab334c43e3d
I20260808 07:01:53.931598 29758 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c135250c6dc4272aeda1ab334c43e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:53 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:53882
I20260808 07:01:53.931615 29988 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c135250c6dc4272aeda1ab334c43e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:53 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:34468
I20260808 07:01:53.931703 30201 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c135250c6dc4272aeda1ab334c43e3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:53 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:44420
I20260808 07:01:53.931877 30458 tablet_replica.cc:330] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: stopping tablet replica
I20260808 07:01:53.931891 30459 tablet_replica.cc:330] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: stopping tablet replica
I20260808 07:01:53.931951 30459 raft_consensus.cc:2229] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:53.931962 30457 tablet_replica.cc:330] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: stopping tablet replica
I20260808 07:01:53.932009 30457 raft_consensus.cc:2229] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:53.931985 30458 raft_consensus.cc:2229] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:01:53.932030 30459 raft_consensus.cc:2258] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:53.932101 30457 raft_consensus.cc:2258] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:53.932129 30458 raft_consensus.cc:2258] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:53.932365 30457 ts_tablet_manager.cc:1905] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:53.932365 30458 ts_tablet_manager.cc:1905] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:53.934041 30457 ts_tablet_manager.cc:1918] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:01:53.934058 30458 ts_tablet_manager.cc:1918] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:01:53.934111 30458 log.cc:1196] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/2c135250c6dc4272aeda1ab334c43e3d
I20260808 07:01:53.934145 30457 log.cc:1196] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/2c135250c6dc4272aeda1ab334c43e3d
I20260808 07:01:53.934412 30458 ts_tablet_manager.cc:1939] T 2c135250c6dc4272aeda1ab334c43e3d P b32c18953fd5493c828b956484f2bcc9: Deleting consensus metadata
I20260808 07:01:53.934453 30457 ts_tablet_manager.cc:1939] T 2c135250c6dc4272aeda1ab334c43e3d P 6de7d585a7c14c728ab9ef42879a071e: Deleting consensus metadata
I20260808 07:01:53.934778 29518 catalog_manager.cc:4841] TS b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263): tablet 2c135250c6dc4272aeda1ab334c43e3d (table test-table [id=b8573911ef2d4f86a9274135844fdb6f]) successfully deleted
I20260808 07:01:53.934859 29518 catalog_manager.cc:4841] TS 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177): tablet 2c135250c6dc4272aeda1ab334c43e3d (table test-table [id=b8573911ef2d4f86a9274135844fdb6f]) successfully deleted
I20260808 07:01:53.935132 30459 ts_tablet_manager.cc:1905] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:53.936348 30459 ts_tablet_manager.cc:1918] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:01:53.936403 30459 log.cc:1196] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/2c135250c6dc4272aeda1ab334c43e3d
I20260808 07:01:53.936581 30459 ts_tablet_manager.cc:1939] T 2c135250c6dc4272aeda1ab334c43e3d P c019af530a714f528db7d7e5ab50acec: Deleting consensus metadata
I20260808 07:01:53.936885 29514 catalog_manager.cc:4841] TS c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627): tablet 2c135250c6dc4272aeda1ab334c43e3d (table test-table [id=b8573911ef2d4f86a9274135844fdb6f]) successfully deleted
Aug 08 07:01:53 dist-test-slave-zj8q krb5kdc[29467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172513, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:01:53 dist-test-slave-zj8q krb5kdc[29467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172513, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:53.956573 30476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:53.949980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45152 (local address 127.26.23.190:41919)
0808 07:01:53.950112 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:53.950114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:53.950125 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:01:53.950228 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:53.950228 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:53.950241 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:53.950299 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:53.950825 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:53.951341 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:53.952020 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:53.952226 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:53.952274 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:53.954274 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:53.954276 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:53.954276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:53.954282 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:53.955574 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:53.955875 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:53.955877 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:53.955877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:53.955930 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:53.956098 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:53.956098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:53.956099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:53.956204 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:53.956289 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:53.956391 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:01:53.956475 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":73,"threads_started":1}
I20260808 07:01:53.957856 29535 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:01:53.957998 29535 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:53.959287 29758 tablet_service.cc:1467] Processing CreateTablet for tablet 6a47e7e516a0482387cdd8292f86ad9f (DEFAULT_TABLE table=test-table [id=e22b1741f5e447e6a187ea79ef97eb27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:53.959306 29988 tablet_service.cc:1467] Processing CreateTablet for tablet 6a47e7e516a0482387cdd8292f86ad9f (DEFAULT_TABLE table=test-table [id=e22b1741f5e447e6a187ea79ef97eb27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:53.959322 30201 tablet_service.cc:1467] Processing CreateTablet for tablet 6a47e7e516a0482387cdd8292f86ad9f (DEFAULT_TABLE table=test-table [id=e22b1741f5e447e6a187ea79ef97eb27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:53.959425 30201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a47e7e516a0482387cdd8292f86ad9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:53.959429 29758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a47e7e516a0482387cdd8292f86ad9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:53.959432 29988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a47e7e516a0482387cdd8292f86ad9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:53.960752 30482 tablet_bootstrap.cc:492] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Bootstrap starting.
I20260808 07:01:53.960753 30480 tablet_bootstrap.cc:492] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Bootstrap starting.
I20260808 07:01:53.961130 30482 tablet_bootstrap.cc:654] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:53.961130 30480 tablet_bootstrap.cc:654] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:53.961433 30481 tablet_bootstrap.cc:492] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Bootstrap starting.
I20260808 07:01:53.961740 30481 tablet_bootstrap.cc:654] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:53.961753 30482 tablet_bootstrap.cc:492] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: No bootstrap required, opened a new log
I20260808 07:01:53.961797 30482 ts_tablet_manager.cc:1397] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:53.961910 30480 tablet_bootstrap.cc:492] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: No bootstrap required, opened a new log
I20260808 07:01:53.961966 30480 ts_tablet_manager.cc:1397] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:53.961938 30482 raft_consensus.cc:348] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:53.962007 30482 raft_consensus.cc:374] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:53.962067 30482 raft_consensus.cc:729] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c019af530a714f528db7d7e5ab50acec, State: Initialized, Role: FOLLOWER
I20260808 07:01:53.962119 30480 raft_consensus.cc:348] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:53.962141 30482 consensus_queue.cc:260] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:53.962214 30480 raft_consensus.cc:374] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:53.962255 30480 raft_consensus.cc:729] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Initialized, Role: FOLLOWER
I20260808 07:01:53.962340 30482 ts_tablet_manager.cc:1428] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:53.962330 30480 consensus_queue.cc:260] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:53.962400 30481 tablet_bootstrap.cc:492] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: No bootstrap required, opened a new log
I20260808 07:01:53.962458 30481 ts_tablet_manager.cc:1397] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:53.962623 30480 ts_tablet_manager.cc:1428] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:01:53.962643 30481 raft_consensus.cc:348] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:53.962749 30481 raft_consensus.cc:374] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:53.962798 30481 raft_consensus.cc:729] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de7d585a7c14c728ab9ef42879a071e, State: Initialized, Role: FOLLOWER
I20260808 07:01:53.962868 30481 consensus_queue.cc:260] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:53.963076 30481 ts_tablet_manager.cc:1428] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:01:54.225054 30357 raft_consensus.cc:482] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:54.225167 30357 raft_consensus.cc:504] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.225327 30357 leader_election.cc:288] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:54.225595 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a47e7e516a0482387cdd8292f86ad9f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec" is_pre_election: true
I20260808 07:01:54.225592 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a47e7e516a0482387cdd8292f86ad9f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e" is_pre_election: true
I20260808 07:01:54.225703 29790 raft_consensus.cc:2454] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:54.225703 30238 raft_consensus.cc:2454] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:54.225876 29908 leader_election.cc:302] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32c18953fd5493c828b956484f2bcc9, c019af530a714f528db7d7e5ab50acec; no voters:
I20260808 07:01:54.226022 30357 raft_consensus.cc:2781] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:54.226076 30357 raft_consensus.cc:482] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:54.226090 30357 raft_consensus.cc:3037] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:54.227063 30357 raft_consensus.cc:504] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.227200 30357 leader_election.cc:288] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:54.227368 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a47e7e516a0482387cdd8292f86ad9f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e"
I20260808 07:01:54.227367 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a47e7e516a0482387cdd8292f86ad9f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec"
I20260808 07:01:54.227440 30238 raft_consensus.cc:3037] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:54.227442 29790 raft_consensus.cc:3037] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:54.227996 29790 raft_consensus.cc:2454] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:54.228077 30238 raft_consensus.cc:2454] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:54.228197 29912 leader_election.cc:302] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de7d585a7c14c728ab9ef42879a071e, b32c18953fd5493c828b956484f2bcc9; no voters:
I20260808 07:01:54.228283 30357 raft_consensus.cc:2781] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:54.228339 30357 raft_consensus.cc:686] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Running, Role: LEADER
I20260808 07:01:54.228390 30357 consensus_queue.cc:237] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.229000 29533 catalog_manager.cc:5495] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b32c18953fd5493c828b956484f2bcc9 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } health_report { overall_health: UNKNOWN } } }
I20260808 07:01:54.245925 30493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:54.243602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38788 (local address 127.26.23.130:34263)
0808 07:01:54.243752 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:54.243754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:54.243761 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:01:54.243780 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:54.243781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:54.243790 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:54.243844 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:01:54.244029 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:54.244585 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:54.245329 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:54.245550 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:54.245597 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:54.245754 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:01:54.245780 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:01:54.245808 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:54.245847 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:01:54.245863 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":106,"threads_started":1}
I20260808 07:01:54.247893 29790 raft_consensus.cc:1261] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:54.247893 30238 raft_consensus.cc:1261] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:54.248122 30429 consensus_queue.cc:1035] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:54.248294 30429 consensus_queue.cc:1035] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:54.258232 29533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:54.258322 29533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:54.258858 29533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Sending DeleteTablet for 3 replicas of tablet 6a47e7e516a0482387cdd8292f86ad9f
I20260808 07:01:54.259088 30201 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a47e7e516a0482387cdd8292f86ad9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:54 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:44420
I20260808 07:01:54.259109 29988 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a47e7e516a0482387cdd8292f86ad9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:54 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:34468
I20260808 07:01:54.259121 29758 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a47e7e516a0482387cdd8292f86ad9f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:54 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:53882
I20260808 07:01:54.259189 30459 tablet_replica.cc:330] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: stopping tablet replica
I20260808 07:01:54.259204 30457 tablet_replica.cc:330] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: stopping tablet replica
I20260808 07:01:54.259243 30459 raft_consensus.cc:2229] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:54.259251 30457 raft_consensus.cc:2229] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:54.259284 30459 raft_consensus.cc:2258] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:54.259284 30457 raft_consensus.cc:2258] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:54.259353 30458 tablet_replica.cc:330] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: stopping tablet replica
I20260808 07:01:54.259305 29533 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 07:01:54.259398 30458 raft_consensus.cc:2229] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Raft consensus shutting down.
W20260808 07:01:54.259433 29533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:01:54.259444 30458 raft_consensus.cc:2258] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:54.259709 30459 ts_tablet_manager.cc:1905] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:54.259814 30458 ts_tablet_manager.cc:1905] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:54.260618 30201 tablet_service.cc:1467] Processing CreateTablet for tablet cc713692f5874bda9952a22168db606f (DEFAULT_TABLE table=test-table [id=6ee59db359a4404eb399d3541ee1c42a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:54.260669 29758 tablet_service.cc:1467] Processing CreateTablet for tablet cc713692f5874bda9952a22168db606f (DEFAULT_TABLE table=test-table [id=6ee59db359a4404eb399d3541ee1c42a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:54.260713 30201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc713692f5874bda9952a22168db606f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:54.260779 29758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc713692f5874bda9952a22168db606f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:54.261490 30459 ts_tablet_manager.cc:1918] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:54.261498 30458 ts_tablet_manager.cc:1918] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:54.261546 30459 log.cc:1196] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/6a47e7e516a0482387cdd8292f86ad9f
I20260808 07:01:54.261546 30458 log.cc:1196] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/6a47e7e516a0482387cdd8292f86ad9f
I20260808 07:01:54.261605 30457 ts_tablet_manager.cc:1905] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:54.261765 30458 ts_tablet_manager.cc:1939] T 6a47e7e516a0482387cdd8292f86ad9f P b32c18953fd5493c828b956484f2bcc9: Deleting consensus metadata
I20260808 07:01:54.261765 30459 ts_tablet_manager.cc:1939] T 6a47e7e516a0482387cdd8292f86ad9f P c019af530a714f528db7d7e5ab50acec: Deleting consensus metadata
I20260808 07:01:54.262070 30481 tablet_bootstrap.cc:492] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e: Bootstrap starting.
I20260808 07:01:54.262459 30482 tablet_bootstrap.cc:492] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Bootstrap starting.
I20260808 07:01:54.262660 30481 tablet_bootstrap.cc:654] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:54.262750 30482 tablet_bootstrap.cc:654] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:54.262914 30457 ts_tablet_manager.cc:1918] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:01:54.262969 30457 log.cc:1196] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/6a47e7e516a0482387cdd8292f86ad9f
I20260808 07:01:54.263046 29514 catalog_manager.cc:4841] TS c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627): tablet 6a47e7e516a0482387cdd8292f86ad9f (table test-table [id=e22b1741f5e447e6a187ea79ef97eb27]) successfully deleted
I20260808 07:01:54.263178 30457 ts_tablet_manager.cc:1939] T 6a47e7e516a0482387cdd8292f86ad9f P 6de7d585a7c14c728ab9ef42879a071e: Deleting consensus metadata
I20260808 07:01:54.263309 30481 tablet_bootstrap.cc:492] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e: No bootstrap required, opened a new log
I20260808 07:01:54.263355 30481 ts_tablet_manager.cc:1397] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:01:54.263453 29518 catalog_manager.cc:4841] TS b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263): tablet 6a47e7e516a0482387cdd8292f86ad9f (table test-table [id=e22b1741f5e447e6a187ea79ef97eb27]) successfully deleted
I20260808 07:01:54.263496 29988 tablet_service.cc:1467] Processing CreateTablet for tablet cc713692f5874bda9952a22168db606f (DEFAULT_TABLE table=test-table [id=6ee59db359a4404eb399d3541ee1c42a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:01:54.263496 30481 raft_consensus.cc:348] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.263563 30481 raft_consensus.cc:374] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:54.263592 30481 raft_consensus.cc:729] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6de7d585a7c14c728ab9ef42879a071e, State: Initialized, Role: FOLLOWER
I20260808 07:01:54.263607 29988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc713692f5874bda9952a22168db606f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:54.263639 30481 consensus_queue.cc:260] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.263736 30481 ts_tablet_manager.cc:1428] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:54.263862 29518 catalog_manager.cc:4841] TS 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177): tablet 6a47e7e516a0482387cdd8292f86ad9f (table test-table [id=e22b1741f5e447e6a187ea79ef97eb27]) successfully deleted
I20260808 07:01:54.264717 30480 tablet_bootstrap.cc:492] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Bootstrap starting.
I20260808 07:01:54.264986 30480 tablet_bootstrap.cc:654] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:54.265012 30482 tablet_bootstrap.cc:492] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: No bootstrap required, opened a new log
I20260808 07:01:54.265044 30482 ts_tablet_manager.cc:1397] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260808 07:01:54.265116 30482 raft_consensus.cc:348] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.265159 30482 raft_consensus.cc:374] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:54.265172 30482 raft_consensus.cc:729] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c019af530a714f528db7d7e5ab50acec, State: Initialized, Role: FOLLOWER
I20260808 07:01:54.265206 30482 consensus_queue.cc:260] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.265287 30482 ts_tablet_manager.cc:1428] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:54.265447 30480 tablet_bootstrap.cc:492] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: No bootstrap required, opened a new log
I20260808 07:01:54.265480 30480 ts_tablet_manager.cc:1397] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:01:54.265566 30480 raft_consensus.cc:348] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.265606 30480 raft_consensus.cc:374] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:54.265618 30480 raft_consensus.cc:729] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Initialized, Role: FOLLOWER
I20260808 07:01:54.265650 30480 consensus_queue.cc:260] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.265705 30480 ts_tablet_manager.cc:1428] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:54.516721 30429 raft_consensus.cc:482] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:01:54.516830 30429 raft_consensus.cc:504] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.517014 30429 leader_election.cc:288] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:54.517274 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc713692f5874bda9952a22168db606f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e" is_pre_election: true
I20260808 07:01:54.517314 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc713692f5874bda9952a22168db606f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec" is_pre_election: true
I20260808 07:01:54.517395 29790 raft_consensus.cc:2454] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:54.517405 30238 raft_consensus.cc:2454] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 0.
I20260808 07:01:54.517562 29912 leader_election.cc:302] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6de7d585a7c14c728ab9ef42879a071e, b32c18953fd5493c828b956484f2bcc9; no voters:
I20260808 07:01:54.517688 30429 raft_consensus.cc:2781] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:01:54.517724 30429 raft_consensus.cc:482] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:01:54.517750 30429 raft_consensus.cc:3037] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:54.518481 30429 raft_consensus.cc:504] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.518612 30429 leader_election.cc:288] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Requested vote from peers 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177), c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627)
I20260808 07:01:54.518778 30238 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc713692f5874bda9952a22168db606f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c019af530a714f528db7d7e5ab50acec"
I20260808 07:01:54.518852 30238 raft_consensus.cc:3037] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:54.518782 29790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc713692f5874bda9952a22168db606f" candidate_uuid: "b32c18953fd5493c828b956484f2bcc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6de7d585a7c14c728ab9ef42879a071e"
I20260808 07:01:54.518884 29790 raft_consensus.cc:3037] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:54.519488 30238 raft_consensus.cc:2454] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:54.519495 29790 raft_consensus.cc:2454] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b32c18953fd5493c828b956484f2bcc9 in term 1.
I20260808 07:01:54.519663 29908 leader_election.cc:302] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b32c18953fd5493c828b956484f2bcc9, c019af530a714f528db7d7e5ab50acec; no voters:
I20260808 07:01:54.519763 30429 raft_consensus.cc:2781] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:54.519817 30429 raft_consensus.cc:686] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Becoming Leader. State: Replica: b32c18953fd5493c828b956484f2bcc9, State: Running, Role: LEADER
I20260808 07:01:54.519860 30429 consensus_queue.cc:237] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } }
I20260808 07:01:54.520455 29535 catalog_manager.cc:5495] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to b32c18953fd5493c828b956484f2bcc9 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "b32c18953fd5493c828b956484f2bcc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b32c18953fd5493c828b956484f2bcc9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 34263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 } health_report { overall_health: UNKNOWN } } }
I20260808 07:01:54.550187 29790 raft_consensus.cc:1261] T cc713692f5874bda9952a22168db606f P 6de7d585a7c14c728ab9ef42879a071e [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:54.550192 30238 raft_consensus.cc:1261] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Refusing update from remote peer b32c18953fd5493c828b956484f2bcc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:01:54.550390 30429 consensus_queue.cc:1035] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6de7d585a7c14c728ab9ef42879a071e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 39177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:01:54.550513 30357 consensus_queue.cc:1035] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c019af530a714f528db7d7e5ab50acec" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:01:54.554329 30427 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 07:01:56.071136 29535 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:56.071249 29535 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:01:56.072124 29535 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a50714ee2204439bd1f136abb04552b: Sending DeleteTablet for 3 replicas of tablet cc713692f5874bda9952a22168db606f
I20260808 07:01:56.072397 30201 tablet_service.cc:1514] Processing DeleteTablet for tablet cc713692f5874bda9952a22168db606f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:56 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:44420
I20260808 07:01:56.072402 29758 tablet_service.cc:1514] Processing DeleteTablet for tablet cc713692f5874bda9952a22168db606f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:56 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:53882
I20260808 07:01:56.072522 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29661
I20260808 07:01:56.072589 29987 tablet_service.cc:1514] Processing DeleteTablet for tablet cc713692f5874bda9952a22168db606f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:01:56 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:34468
I20260808 07:01:56.076785 30540 tablet_replica.cc:330] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: stopping tablet replica
I20260808 07:01:56.076865 30540 raft_consensus.cc:2229] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:01:56.076912 30540 raft_consensus.cc:2258] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:56.081578 30540 ts_tablet_manager.cc:1905] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:56.082250 30539 tablet_replica.cc:330] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: stopping tablet replica
I20260808 07:01:56.082316 30539 raft_consensus.cc:2229] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:01:56.082365 30539 raft_consensus.cc:2258] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:01:56.082643 30539 ts_tablet_manager.cc:1905] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:01:56.083285 30540 ts_tablet_manager.cc:1918] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:01:56.083350 30540 log.cc:1196] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/cc713692f5874bda9952a22168db606f
I20260808 07:01:56.083583 30540 ts_tablet_manager.cc:1939] T cc713692f5874bda9952a22168db606f P b32c18953fd5493c828b956484f2bcc9: Deleting consensus metadata
I20260808 07:01:56.083973 30539 ts_tablet_manager.cc:1918] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 07:01:56.084040 30539 log.cc:1196] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/cc713692f5874bda9952a22168db606f
I20260808 07:01:56.083968 29518 catalog_manager.cc:4841] TS b32c18953fd5493c828b956484f2bcc9 (127.26.23.130:34263): tablet cc713692f5874bda9952a22168db606f (table test-table [id=6ee59db359a4404eb399d3541ee1c42a]) successfully deleted
I20260808 07:01:56.084261 30539 ts_tablet_manager.cc:1939] T cc713692f5874bda9952a22168db606f P c019af530a714f528db7d7e5ab50acec: Deleting consensus metadata
I20260808 07:01:56.084600 29514 catalog_manager.cc:4841] TS c019af530a714f528db7d7e5ab50acec (127.26.23.131:36627): tablet cc713692f5874bda9952a22168db606f (table test-table [id=6ee59db359a4404eb399d3541ee1c42a]) successfully deleted
W20260808 07:01:56.088157 29518 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:39177 (error 108)
I20260808 07:01:56.088443 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29879
I20260808 07:01:56.096340 30542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:56.088594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:39177 (local address 127.0.0.1:57558)
0808 07:01:56.096224 (+ 7630us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:56.096293 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7598,"thread_start_us":70,"threads_started":1}
W20260808 07:01:56.096453 29518 catalog_manager.cc:4584] TS 6de7d585a7c14c728ab9ef42879a071e (127.26.23.129:39177): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cc713692f5874bda9952a22168db606f: Network error: Client connection negotiation failed: client connection to 127.26.23.129:39177: connect: Connection refused (error 111)
I20260808 07:01:56.100966 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30102
I20260808 07:01:56.115257 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29488
2026-08-08T07:01:56Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6019 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:56 dist-test-slave-zj8q krb5kdc[30547](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:56 dist-test-slave-zj8q krb5kdc[30547](info): set up 2 sockets
Aug 08 07:01:56 dist-test-slave-zj8q krb5kdc[30547](info): commencing operation
krb5kdc: starting...
W20260808 07:01:57.271540 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:01:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:01:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:01:57.386265 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:45165
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:33189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:45165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:57.467331 30565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:57.467540 30565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:57.467561 30565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:57.468647 30565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:01:57.468679 30565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:57.468693 30565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:57.468703 30565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:01:57.468714 30565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:01:57.470126 30565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:33189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:45165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:45165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:57.470366 30565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:57.470551 30565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:57.475271 30574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.475354 30579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:57.475337 30565 server_base.cc:1034] running on GCE node
W20260808 07:01:57.475291 30571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:57.475824 30565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:57.476078 30565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:57.477223 30565 hybrid_clock.cc:648] HybridClock initialized: now 1786172517477213 us; error 30 us; skew 500 ppm
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:57.479594 30565 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:01:57.480032 30565 webserver.cc:460] Webserver started at http://127.26.23.190:42369/ using document root <none> and password file <none>
I20260808 07:01:57.480240 30565 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:57.480283 30565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:57.480398 30565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:57.481446 30565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "293f12abb20a3a4d1465201134c1f3fc"
server_key_iv: "dfc112f2dddd52dee419eb674b5a7d2b"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.481777 30565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "293f12abb20a3a4d1465201134c1f3fc"
server_key_iv: "dfc112f2dddd52dee419eb674b5a7d2b"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.483042 30565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:01:57.483697 30587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.483851 30565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:57.483937 30565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "293f12abb20a3a4d1465201134c1f3fc"
server_key_iv: "dfc112f2dddd52dee419eb674b5a7d2b"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.483999 30565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:57.491947 30565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:57.493659 30565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:57.493780 30565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:57.497756 30565 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:45165
I20260808 07:01:57.497797 30666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:45165 every 8 connection(s)
I20260808 07:01:57.498133 30565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:01:57.499027 30667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:57.500571 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30565
I20260808 07:01:57.500656 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:01:57.500805 26718 external_mini_cluster.cc:1428] Setting key 03153881982010673e4f0a3b1eebd9d6
I20260808 07:01:57.501524 30667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69: Bootstrap starting.
I20260808 07:01:57.502112 30667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:57.502475 30667 log.cc:824] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:57.503228 30667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69: No bootstrap required, opened a new log
I20260808 07:01:57.505354 30667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 45165 } }
I20260808 07:01:57.505504 30667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:57.505580 30667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b5e9c1d92b749d3aa4fd154fe90ac69, State: Initialized, Role: FOLLOWER
I20260808 07:01:57.505714 30667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 45165 } }
I20260808 07:01:57.505789 30667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:01:57.505813 30667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:01:57.505857 30667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:57.506438 30667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 45165 } }
I20260808 07:01:57.506524 30667 leader_election.cc:302] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b5e9c1d92b749d3aa4fd154fe90ac69; no voters:
I20260808 07:01:57.506680 30667 leader_election.cc:288] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:01:57.506716 30673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:57.506877 30673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [term 1 LEADER]: Becoming Leader. State: Replica: 6b5e9c1d92b749d3aa4fd154fe90ac69, State: Running, Role: LEADER
I20260808 07:01:57.506937 30667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:01:57.506989 30673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 45165 } }
I20260808 07:01:57.507488 30675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b5e9c1d92b749d3aa4fd154fe90ac69. Latest consensus state: current_term: 1 leader_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 45165 } } }
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:57.507637 30675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:57.507961 30674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b5e9c1d92b749d3aa4fd154fe90ac69" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 45165 } } }
I20260808 07:01:57.508088 30674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69 [sys.catalog]: This master's current role is: LEADER
W20260808 07:01:57.508935 30699 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:01:57.509034 30699 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:01:57.509133 30688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:01:57.509277 30688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:01:57.511401 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:57.501292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.26.23.190:45165)
0808 07:01:57.501456 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:57.501463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:57.501488 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:01:57.501927 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:57.501935 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:57.501992 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:57.502128 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:57.502995 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.503949 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.504983 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.505388 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.505466 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:57.508193 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:57.508197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:57.508197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:57.508210 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:57.509982 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:57.510398 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:57.510401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:57.510402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:57.510487 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:57.510679 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:57.510679 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:57.510680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:57.510885 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:57.510998 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:57.511109 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 07:01:57.511207 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":61,"threads_started":1}
I20260808 07:01:57.514544 30688 catalog_manager.cc:1347] Generated new cluster ID: 592306e0030047db8d6cd57fc5815bd2
I20260808 07:01:57.514601 30688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:01:57.538364 30688 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:01:57.538900 30688 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:01:57.541642 30688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b5e9c1d92b749d3aa4fd154fe90ac69: Generated new TSK 0
I20260808 07:01:57.541819 30688 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:01:57.576953 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:45165
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:33189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:57.680593 30707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:57.680789 30707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:57.680811 30707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:57.681943 30707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:57.681983 30707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:57.682008 30707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:01:57.683450 30707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:33189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:45165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:57.683665 30707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:57.683872 30707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:57.688903 30719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.688876 30715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.688884 30716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:57.689145 30707 server_base.cc:1034] running on GCE node
I20260808 07:01:57.689448 30707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:57.689675 30707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:57.690815 30707 hybrid_clock.cc:648] HybridClock initialized: now 1786172517690800 us; error 26 us; skew 500 ppm
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:57.693327 30707 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:01:57.693799 30707 webserver.cc:460] Webserver started at http://127.26.23.129:34723/ using document root <none> and password file <none>
I20260808 07:01:57.694018 30707 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:57.694075 30707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:57.694233 30707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:57.695250 30707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "0113baa0068b49b9a61eb5f4ab394df3"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "27d2fcd45aa0c8f68889f5749261b8cd"
server_key_iv: "c70f1b923a2b32ef7a3f661e04e49f25"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.695581 30707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "0113baa0068b49b9a61eb5f4ab394df3"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "27d2fcd45aa0c8f68889f5749261b8cd"
server_key_iv: "c70f1b923a2b32ef7a3f661e04e49f25"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.696805 30707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:01:57.697526 30728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.697741 30707 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:01:57.697815 30707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "0113baa0068b49b9a61eb5f4ab394df3"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "27d2fcd45aa0c8f68889f5749261b8cd"
server_key_iv: "c70f1b923a2b32ef7a3f661e04e49f25"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.697880 30707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:57.721351 30707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:57.723594 30707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:57.723737 30707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:57.723956 30707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:57.724258 30707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:57.724292 30707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.724320 30707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:57.724337 30707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.729804 30707 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:35741
I20260808 07:01:57.729871 30904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:35741 every 8 connection(s)
I20260808 07:01:57.730168 30707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:01:57.732847 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30707
I20260808 07:01:57.732920 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:01:57.733083 26718 external_mini_cluster.cc:1428] Setting key 0df8d6fe708ae2dca2a3df5eb84b92e7
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:57.740353 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:57.730858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:50649 (local address 127.26.23.190:45165)
0808 07:01:57.730945 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:57.730948 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:57.731148 (+ 200us) server_negotiation.cc:407] Connection header received
0808 07:01:57.731722 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:57.731724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:57.731743 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:57.731798 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:57.732761 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.733427 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.734739 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.734936 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.734990 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:57.737275 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:57.737276 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:57.737277 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:57.737285 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:57.738755 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:57.739299 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:57.739301 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:57.739301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:57.739400 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:57.739711 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:57.739712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:57.739713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:57.739830 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:57.739879 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:57.740210 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 07:01:57.740286 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 07:01:57.740590 30909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:57.730813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:45165 (local address 127.26.23.129:50649)
0808 07:01:57.731015 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:57.731063 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:57.731616 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:57.731870 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:57.731873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:57.732445 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:57.732651 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:57.732658 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.733509 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.733510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:57.734661 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:57.734665 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.735011 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.735011 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:57.735160 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:57.735617 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:57.735628 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:57.737183 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:57.738851 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:57.738859 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:57.738861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:57.739166 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:57.739502 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:57.739504 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:57.739504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:57.739645 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:57.739888 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:57.739895 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:57.740064 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 07:01:57.740191 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 07:01:57.740363 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260808 07:01:57.741123 30906 heartbeater.cc:347] Connected to a master server at 127.26.23.190:45165
I20260808 07:01:57.741214 30906 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:57.741384 30906 heartbeater.cc:511] Master 127.26.23.190:45165 requested a full tablet report, sending...
I20260808 07:01:57.741887 30613 ts_manager.cc:194] Registered new tserver with Master: 0113baa0068b49b9a61eb5f4ab394df3 (127.26.23.129:35741)
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
I20260808 07:01:57.742576 30613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:50649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:01:57.759176 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:45165
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:33189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:57.840296 30914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:57.840489 30914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:57.840518 30914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:57.841640 30914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:57.841679 30914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:57.841713 30914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:01:57.843143 30914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:33189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:45165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:57.843390 30914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:57.843604 30914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:57.848608 30923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.848587 30926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.848587 30924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:57.848659 30914 server_base.cc:1034] running on GCE node
I20260808 07:01:57.848994 30914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:57.849259 30914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:57.850396 30914 hybrid_clock.cc:648] HybridClock initialized: now 1786172517850385 us; error 30 us; skew 500 ppm
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:57.852782 30914 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:01:57.853247 30914 webserver.cc:460] Webserver started at http://127.26.23.130:44491/ using document root <none> and password file <none>
I20260808 07:01:57.853462 30914 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:57.853510 30914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:57.853633 30914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:57.854671 30914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "583ec9f5aa174a0a9f5449625229aee4"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "36dc907796b1b563e474616a0a6fe01c"
server_key_iv: "e8eaf14b5450b592cba240e9a10dd1e3"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.854997 30914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "583ec9f5aa174a0a9f5449625229aee4"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "36dc907796b1b563e474616a0a6fe01c"
server_key_iv: "e8eaf14b5450b592cba240e9a10dd1e3"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.856220 30914 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:01:57.856901 30940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.857066 30914 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:57.857157 30914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "583ec9f5aa174a0a9f5449625229aee4"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "36dc907796b1b563e474616a0a6fe01c"
server_key_iv: "e8eaf14b5450b592cba240e9a10dd1e3"
server_key_version: "encryptionkey@0"
I20260808 07:01:57.857218 30914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:57.870642 30914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:57.872264 30914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:57.872393 30914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:57.872578 30914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:57.872859 30914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:57.872892 30914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.872920 30914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:57.872937 30914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:57.878583 30914 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:41417
I20260808 07:01:57.878652 31107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:41417 every 8 connection(s)
I20260808 07:01:57.878911 30914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:01:57.883821 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30914
I20260808 07:01:57.883919 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:01:57.884124 26718 external_mini_cluster.cc:1428] Setting key 1cf6ba5dbc9b9f49ce5e4b402045ca36
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:57.887902 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:57.879538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:59853 (local address 127.26.23.190:45165)
0808 07:01:57.879614 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:57.879616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:57.879745 (+ 129us) server_negotiation.cc:407] Connection header received
0808 07:01:57.880233 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:57.880234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:57.880246 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:57.880299 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:57.881173 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.881709 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.882749 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.882932 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.882981 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:57.885076 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:57.885078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:57.885078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:57.885085 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:57.886490 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:57.886982 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:57.886983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:57.886983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:57.887034 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:57.887318 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:57.887318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:57.887318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:57.887414 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:57.887463 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:57.887771 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 07:01:57.887839 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:01:57.888085 31112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:57.879485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:45165 (local address 127.26.23.130:59853)
0808 07:01:57.879640 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:57.879674 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:57.880135 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:57.880350 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:57.880354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:57.880901 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:57.881077 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:57.881082 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.881786 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.881787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:57.882678 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:57.882681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:57.882987 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:57.882988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:57.883088 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:57.883469 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:57.883477 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:57.884991 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:57.886584 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:57.886593 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:57.886595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:57.886912 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:57.887089 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:57.887089 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:57.887090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:57.887264 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:57.887467 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:57.887472 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:57.887621 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 07:01:57.887734 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 07:01:57.887891 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260808 07:01:57.888631 31108 heartbeater.cc:347] Connected to a master server at 127.26.23.190:45165
I20260808 07:01:57.888723 31108 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:57.888891 31108 heartbeater.cc:511] Master 127.26.23.190:45165 requested a full tablet report, sending...
I20260808 07:01:57.889263 30613 ts_manager.cc:194] Registered new tserver with Master: 583ec9f5aa174a0a9f5449625229aee4 (127.26.23.130:41417)
I20260808 07:01:57.889617 30613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:59853
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:01:57.909540 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:45165
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:33189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:57.988626 31116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:57.988821 31116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:57.988852 31116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:57.989965 31116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:57.990005 31116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:57.990039 31116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:01:57.991495 31116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:33189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:45165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:57.991746 31116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:57.991952 31116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:01:57.996833 31116 server_base.cc:1034] running on GCE node
W20260808 07:01:57.996821 31121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.996805 31122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:57.996819 31126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:57.997210 31116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:57.997399 31116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:57.998589 31116 hybrid_clock.cc:648] HybridClock initialized: now 1786172517998576 us; error 26 us; skew 500 ppm
Aug 08 07:01:57 dist-test-slave-zj8q krb5kdc[30547](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:58.001109 31116 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:01:58.001498 31116 webserver.cc:460] Webserver started at http://127.26.23.131:36309/ using document root <none> and password file <none>
I20260808 07:01:58.001730 31116 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:58.001776 31116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:58.001871 31116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:58.002897 31116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "e618349e3e2e4059aeaea878e7187cdd"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "7c6aae8c99c2e799ea48997802bc8155"
server_key_iv: "7128906ccbb260388d64eb8d56c8bb20"
server_key_version: "encryptionkey@0"
I20260808 07:01:58.003219 31116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "e618349e3e2e4059aeaea878e7187cdd"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "7c6aae8c99c2e799ea48997802bc8155"
server_key_iv: "7128906ccbb260388d64eb8d56c8bb20"
server_key_version: "encryptionkey@0"
I20260808 07:01:58.004468 31116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:01:58.005175 31138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:58.005306 31116 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:01:58.005383 31116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "e618349e3e2e4059aeaea878e7187cdd"
format_stamp: "Formatted at 2026-08-08 07:01:57 on dist-test-slave-zj8q"
server_key: "7c6aae8c99c2e799ea48997802bc8155"
server_key_iv: "7128906ccbb260388d64eb8d56c8bb20"
server_key_version: "encryptionkey@0"
I20260808 07:01:58.005448 31116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:58.034534 31116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:58.036244 31116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:58.036381 31116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:58.036600 31116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:01:58.036900 31116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:01:58.036933 31116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:58.036957 31116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:01:58.036980 31116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:58.042824 31116 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:35115
I20260808 07:01:58.042879 31300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:35115 every 8 connection(s)
I20260808 07:01:58.043169 31116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:01:58.044525 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 31116
I20260808 07:01:58.044608 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:01:58.044771 26718 external_mini_cluster.cc:1428] Setting key 564084a6b3e8cdb3c062b3522896ab7f
Aug 08 07:01:58 dist-test-slave-zj8q krb5kdc[30547](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172517, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:58.051744 30671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:58.043796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:34441 (local address 127.26.23.190:45165)
0808 07:01:58.043837 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:58.043839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:58.044018 (+ 179us) server_negotiation.cc:407] Connection header received
0808 07:01:58.044510 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:58.044511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:58.044526 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:58.044574 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:58.045625 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:58.046130 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:58.047119 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:58.047324 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:58.047380 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:58.049313 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:58.049315 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:58.049315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:58.049323 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:58.050472 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:58.050868 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:58.050869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:58.050869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:58.050925 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:58.051151 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:58.051152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:58.051152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:58.051263 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:58.051318 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:58.051570 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 07:01:58.051653 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:01:58.051916 31303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:58.043766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:45165 (local address 127.26.23.131:34441)
0808 07:01:58.043906 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:01:58.043943 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:01:58.044418 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:01:58.044657 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:01:58.044661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:01:58.045274 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:01:58.045535 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:58.045542 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:58.046245 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:58.046246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:58.047040 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:01:58.047042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:01:58.047393 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:01:58.047394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:01:58.047572 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:58.047943 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:01:58.047951 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:01:58.049227 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:01:58.050586 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:58.050593 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:58.050595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:58.050799 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:58.050981 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:01:58.050981 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:01:58.050982 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:01:58.051093 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:01:58.051318 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:01:58.051325 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:01:58.051454 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:01:58.051548 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:01:58.051699 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
I20260808 07:01:58.052325 31301 heartbeater.cc:347] Connected to a master server at 127.26.23.190:45165
I20260808 07:01:58.052412 31301 heartbeater.cc:464] Registering TS with master...
I20260808 07:01:58.052578 31301 heartbeater.cc:511] Master 127.26.23.190:45165 requested a full tablet report, sending...
I20260808 07:01:58.052973 30613 ts_manager.cc:194] Registered new tserver with Master: e618349e3e2e4059aeaea878e7187cdd (127.26.23.131:35115)
I20260808 07:01:58.053326 30613 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:34441
I20260808 07:01:58.056507 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:01:58.067775 30671 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:01:58.066968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.26.23.190:45165)
0808 07:01:58.067022 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:58.067024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:58.067127 (+ 103us) server_negotiation.cc:407] Connection header received
0808 07:01:58.067183 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:58.067184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:58.067193 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:58.067245 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:58.067719 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44210: BlockingRecv error: recv got EOF from 127.0.0.1:44210 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:01:58.068554 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30707
I20260808 07:01:58.084408 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30914
I20260808 07:01:58.101195 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 31116
I20260808 07:01:58.138178 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30565
2026-08-08T07:01:58Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2022 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:58 dist-test-slave-zj8q krb5kdc[31316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:58 dist-test-slave-zj8q krb5kdc[31316](info): set up 2 sockets
Aug 08 07:01:58 dist-test-slave-zj8q krb5kdc[31316](info): commencing operation
krb5kdc: starting...
W20260808 07:01:59.280261 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:01:59 dist-test-slave-zj8q krb5kdc[31316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:01:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:01:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:01:59.392379 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:38315
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:43715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:38315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:01:59.474475 31340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:01:59.474687 31340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:01:59.474720 31340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:01:59.475845 31340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:01:59.475888 31340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:01:59.475904 31340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:01:59.475920 31340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:01:59.475935 31340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:01:59.477435 31340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:38315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:38315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:01:59.477682 31340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:01:59.477891 31340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:01:59.482549 31353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:01:59.482558 31350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:59.482676 31340 server_base.cc:1034] running on GCE node
W20260808 07:01:59.482558 31357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:01:59.483018 31340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:01:59.483294 31340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:01:59.484427 31340 hybrid_clock.cc:648] HybridClock initialized: now 1786172519484404 us; error 39 us; skew 500 ppm
Aug 08 07:01:59 dist-test-slave-zj8q krb5kdc[31316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172519, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:01:59.486876 31340 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:01:59.487279 31340 webserver.cc:460] Webserver started at http://127.26.23.190:33671/ using document root <none> and password file <none>
I20260808 07:01:59.487485 31340 fs_manager.cc:359] Metadata directory not provided
I20260808 07:01:59.487529 31340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:01:59.487668 31340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:01:59.488679 31340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "016a87ba198d4a4f84136b110382da0b"
format_stamp: "Formatted at 2026-08-08 07:01:59 on dist-test-slave-zj8q"
server_key: "e54ebd87acb524072dff9ba2dafd7861"
server_key_iv: "8351e5a1d3893ac0340b973dcdb5069c"
server_key_version: "encryptionkey@0"
I20260808 07:01:59.488996 31340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "016a87ba198d4a4f84136b110382da0b"
format_stamp: "Formatted at 2026-08-08 07:01:59 on dist-test-slave-zj8q"
server_key: "e54ebd87acb524072dff9ba2dafd7861"
server_key_iv: "8351e5a1d3893ac0340b973dcdb5069c"
server_key_version: "encryptionkey@0"
I20260808 07:01:59.490274 31340 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:01:59.490988 31366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:01:59.491142 31340 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:01:59.491230 31340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "016a87ba198d4a4f84136b110382da0b"
format_stamp: "Formatted at 2026-08-08 07:01:59 on dist-test-slave-zj8q"
server_key: "e54ebd87acb524072dff9ba2dafd7861"
server_key_iv: "8351e5a1d3893ac0340b973dcdb5069c"
server_key_version: "encryptionkey@0"
I20260808 07:01:59.491297 31340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:01:59.513396 31340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:01:59.515142 31340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:01:59.515276 31340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:01:59.519117 31340 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:38315
I20260808 07:01:59.519165 31449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:38315 every 8 connection(s)
I20260808 07:01:59.519603 31340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:01:59.520229 31450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:01:59.522552 31450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b: Bootstrap starting.
I20260808 07:01:59.523123 31450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b: Neither blocks nor log segments found. Creating new log.
I20260808 07:01:59.523417 31450 log.cc:824] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:01:59.524089 31450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b: No bootstrap required, opened a new log
I20260808 07:01:59.525684 31450 raft_consensus.cc:348] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016a87ba198d4a4f84136b110382da0b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38315 } }
I20260808 07:01:59.525818 31450 raft_consensus.cc:374] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:01:59.525840 31450 raft_consensus.cc:729] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016a87ba198d4a4f84136b110382da0b, State: Initialized, Role: FOLLOWER
I20260808 07:01:59.525976 31450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016a87ba198d4a4f84136b110382da0b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38315 } }
I20260808 07:01:59.526044 31450 raft_consensus.cc:388] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:01:59.526067 31450 raft_consensus.cc:482] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:01:59.526093 31450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:01:59.526945 31450 raft_consensus.cc:504] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016a87ba198d4a4f84136b110382da0b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38315 } }
I20260808 07:01:59.527040 31450 leader_election.cc:302] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 016a87ba198d4a4f84136b110382da0b; no voters:
I20260808 07:01:59.527220 31450 leader_election.cc:288] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:01:59.527246 31453 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:01:59.527375 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 31340
I20260808 07:01:59.527406 31453 raft_consensus.cc:686] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [term 1 LEADER]: Becoming Leader. State: Replica: 016a87ba198d4a4f84136b110382da0b, State: Running, Role: LEADER
I20260808 07:01:59.527462 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:01:59.527489 31450 sys_catalog.cc:564] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:01:59.527494 31453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016a87ba198d4a4f84136b110382da0b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38315 } }
I20260808 07:01:59.527637 26718 external_mini_cluster.cc:1428] Setting key cf6497ad869f0e2d07d5b188f0d7524b
I20260808 07:01:59.527854 31453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 016a87ba198d4a4f84136b110382da0b. Latest consensus state: current_term: 1 leader_uuid: "016a87ba198d4a4f84136b110382da0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016a87ba198d4a4f84136b110382da0b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38315 } } }
I20260808 07:01:59.527932 31453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:59.528167 31455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "016a87ba198d4a4f84136b110382da0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "016a87ba198d4a4f84136b110382da0b" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38315 } } }
I20260808 07:01:59.528232 31455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b [sys.catalog]: This master's current role is: LEADER
I20260808 07:01:59.528759 31457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:01:59.529290 31457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:01:59 dist-test-slave-zj8q krb5kdc[31316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:01:59.534994 31457 catalog_manager.cc:1347] Generated new cluster ID: 37744b7e9a54411d80c216d108a73e12
I20260808 07:01:59.535043 31457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:01:59.541683 31463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:59.528645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44492 (local address 127.26.23.190:38315)
0808 07:01:59.528797 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:59.528804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:59.528834 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:01:59.528951 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:59.528959 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:59.529015 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:59.529171 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:59.530021 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:59.531407 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:59.532146 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:59.532769 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:59.532888 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:59.538295 (+ 5407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:59.538299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:59.538300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:01:59.538311 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:59.540142 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:59.540499 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:59.540502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:59.540503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:59.540604 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:01:59.540771 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:01:59.540772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:01:59.540772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:01:59.541092 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:59.541227 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:59.541318 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 07:01:59.541454 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":88,"threads_started":1}
I20260808 07:01:59.542544 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:01:59.550519 31457 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:01:59.551195 31457 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:01:59.558430 31457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 016a87ba198d4a4f84136b110382da0b: Generated new TSK 0
I20260808 07:01:59.558597 31457 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:01:59.568390 31463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:01:59.565068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44506 (local address 127.26.23.190:38315)
0808 07:01:59.565115 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:01:59.565118 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:01:59.565251 (+ 133us) server_negotiation.cc:407] Connection header received
0808 07:01:59.565319 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:01:59.565320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:01:59.565330 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:01:59.565377 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:01:59.565755 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:59.566325 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:59.567034 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:01:59.567263 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:01:59.567318 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:01:59.567944 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:01:59.567945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:01:59.567946 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:01:59.568150 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:01:59.568168 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:01:59.568174 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:01:59.568222 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:01:59.568286 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 07:01:59.568314 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:01:59.570602 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 31340
2026-08-08T07:01:59Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1437 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:01:59 dist-test-slave-zj8q krb5kdc[31510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:01:59 dist-test-slave-zj8q krb5kdc[31510](info): set up 2 sockets
Aug 08 07:01:59 dist-test-slave-zj8q krb5kdc[31510](info): commencing operation
krb5kdc: starting...
W20260808 07:02:00.725508 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:00 dist-test-slave-zj8q krb5kdc[31510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:00.842129 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42013
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:42013
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:00.922860 31530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:00.923050 31530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:00.923071 31530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:00.924181 31530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:00.924226 31530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:00.924239 31530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:00.924263 31530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:00.924285 31530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:00.925756 31530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:42013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:00.925981 31530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:00.926201 31530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:00.930790 31544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:00.930832 31541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:00.930819 31530 server_base.cc:1034] running on GCE node
W20260808 07:02:00.930790 31538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:00.931233 31530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:00.931469 31530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:00.932603 31530 hybrid_clock.cc:648] HybridClock initialized: now 1786172520932589 us; error 30 us; skew 500 ppm
Aug 08 07:02:00 dist-test-slave-zj8q krb5kdc[31510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172520, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:00.934983 31530 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:00.935381 31530 webserver.cc:460] Webserver started at http://127.26.23.190:34813/ using document root <none> and password file <none>
I20260808 07:02:00.935570 31530 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:00.935614 31530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:00.935746 31530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:00.936751 31530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "91582ec5ce2d4866b4f38b30d6908ad4"
format_stamp: "Formatted at 2026-08-08 07:02:00 on dist-test-slave-zj8q"
server_key: "b62ed6ae52ff00eb059da08f08377369"
server_key_iv: "e8f1ef39b0b851b684ddfe3d9e74d47f"
server_key_version: "encryptionkey@0"
I20260808 07:02:00.937076 31530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "91582ec5ce2d4866b4f38b30d6908ad4"
format_stamp: "Formatted at 2026-08-08 07:02:00 on dist-test-slave-zj8q"
server_key: "b62ed6ae52ff00eb059da08f08377369"
server_key_iv: "e8f1ef39b0b851b684ddfe3d9e74d47f"
server_key_version: "encryptionkey@0"
I20260808 07:02:00.938378 31530 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:00.939059 31556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:00.939205 31530 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:00.939291 31530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "91582ec5ce2d4866b4f38b30d6908ad4"
format_stamp: "Formatted at 2026-08-08 07:02:00 on dist-test-slave-zj8q"
server_key: "b62ed6ae52ff00eb059da08f08377369"
server_key_iv: "e8f1ef39b0b851b684ddfe3d9e74d47f"
server_key_version: "encryptionkey@0"
I20260808 07:02:00.939350 31530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:00.951887 31530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:00.953577 31530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:00.953704 31530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:00.957558 31530 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:42013
I20260808 07:02:00.957592 31625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:42013 every 8 connection(s)
I20260808 07:02:00.957901 31530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:00.958945 31627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:00.961179 31627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4: Bootstrap starting.
I20260808 07:02:00.961733 31627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:00.961982 31627 log.cc:824] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:00.962657 31627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4: No bootstrap required, opened a new log
I20260808 07:02:00.964210 31627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42013 } }
I20260808 07:02:00.964341 31627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:00.964363 31627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91582ec5ce2d4866b4f38b30d6908ad4, State: Initialized, Role: FOLLOWER
I20260808 07:02:00.964502 31627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42013 } }
I20260808 07:02:00.964584 31627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:00.964630 31627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:00.964681 31627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:00.965421 31627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42013 } }
I20260808 07:02:00.965528 31627 leader_election.cc:302] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91582ec5ce2d4866b4f38b30d6908ad4; no voters:
I20260808 07:02:00.965696 31627 leader_election.cc:288] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:00.965734 31632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:00.965883 31632 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [term 1 LEADER]: Becoming Leader. State: Replica: 91582ec5ce2d4866b4f38b30d6908ad4, State: Running, Role: LEADER
I20260808 07:02:00.965941 31627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:00.965976 31632 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42013 } }
I20260808 07:02:00.966356 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 31530
I20260808 07:02:00.966411 31635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42013 } } }
I20260808 07:02:00.966466 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:00.966487 31635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:00.966652 26718 external_mini_cluster.cc:1428] Setting key 9c04fc8478d52ac12fb78aa5221d5943
I20260808 07:02:00.966666 31639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91582ec5ce2d4866b4f38b30d6908ad4. Latest consensus state: current_term: 1 leader_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91582ec5ce2d4866b4f38b30d6908ad4" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42013 } } }
I20260808 07:02:00.966722 31639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:00.967033 31654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:00.967543 31654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:00.969997 31654 catalog_manager.cc:1347] Generated new cluster ID: 3c536754a1484c16921cb259e02a1687
I20260808 07:02:00.970046 31654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:00 dist-test-slave-zj8q krb5kdc[31510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:00.978498 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:00.967272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54532 (local address 127.26.23.190:42013)
0808 07:02:00.967447 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:00.967456 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:00.967602 (+ 146us) server_negotiation.cc:407] Connection header received
0808 07:02:00.967721 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:00.967729 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:00.967883 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:00.968021 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:00.968761 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:00.969644 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:00.970784 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:00.971430 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:00.971510 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:00.974358 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:00.974363 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:00.974363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:00.974374 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:00.976634 (+ 2260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:00.977034 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:00.977037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:00.977038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:00.977167 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:00.977378 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:00.977379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:00.977379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:00.977665 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:00.977798 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:00.978065 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:02:00.978258 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260808 07:02:00.988260 31654 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:00.988763 31654 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:00.992475 31654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91582ec5ce2d4866b4f38b30d6908ad4: Generated new TSK 0
I20260808 07:02:00.992625 31654 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:02:01.020124 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42013
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:01.101517 31682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:01.101712 31682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:01.101734 31682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:01.102851 31682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:01.102885 31682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:01.102909 31682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:01.104300 31682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:01.104526 31682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:01.104713 31682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:01.109731 31694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:01.109745 31691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:01.109934 31682 server_base.cc:1034] running on GCE node
W20260808 07:02:01.110785 31688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:01.111001 31682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:01.111223 31682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:01.112372 31682 hybrid_clock.cc:648] HybridClock initialized: now 1786172521112356 us; error 26 us; skew 500 ppm
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:01.114857 31682 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:02:01.115258 31682 webserver.cc:460] Webserver started at http://127.26.23.129:39607/ using document root <none> and password file <none>
I20260808 07:02:01.115446 31682 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:01.115489 31682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:01.115614 31682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:01.116595 31682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "0a4516afd034451a9a0d720c20e94d86"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "9c5dc01c11d1fff82b27fbeeec81c913"
server_key_iv: "4451af34757142f21532b30c5f6702ca"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.116948 31682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "0a4516afd034451a9a0d720c20e94d86"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "9c5dc01c11d1fff82b27fbeeec81c913"
server_key_iv: "4451af34757142f21532b30c5f6702ca"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.118180 31682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:02:01.119007 31704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.119199 31682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:01.119284 31682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "0a4516afd034451a9a0d720c20e94d86"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "9c5dc01c11d1fff82b27fbeeec81c913"
server_key_iv: "4451af34757142f21532b30c5f6702ca"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.119359 31682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:01.127854 31682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:01.129578 31682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:01.129702 31682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:01.129910 31682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:01.130227 31682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:01.130265 31682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.130286 31682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:01.130309 31682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.135921 31682 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:43771
I20260808 07:02:01.135984 31876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:43771 every 8 connection(s)
I20260808 07:02:01.136253 31682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:01.144672 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.136947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:44403 (local address 127.26.23.190:42013)
0808 07:02:01.137005 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:01.137007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:01.137169 (+ 162us) server_negotiation.cc:407] Connection header received
0808 07:02:01.137640 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:01.137642 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:01.137652 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:01.137707 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:01.138622 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.139126 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.140065 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.140280 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.140322 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.142282 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:01.142284 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:01.142284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:01.142290 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:01.143443 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.143784 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.143785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.143785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.143834 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.144150 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.144151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.144151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.144268 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:01.144320 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:01.144526 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 07:02:01.144597 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:01.144834 31879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.136898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42013 (local address 127.26.23.129:44403)
0808 07:02:01.137052 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:01.137092 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:01.137554 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:01.137759 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:01.137762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:01.138358 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:01.138544 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:01.138550 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.139188 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.139189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:01.140005 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:01.140008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.140332 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.140333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:01.140424 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.140855 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:01.140863 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:01.142206 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:01.143509 (+ 1303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:01.143516 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:01.143518 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:01.143727 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:01.143946 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:01.143947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:01.143947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:01.144079 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:01.144319 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:01.144322 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:01.144431 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 07:02:01.144506 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 07:02:01.144641 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260808 07:02:01.145028 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 31682
I20260808 07:02:01.145116 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:01.145272 26718 external_mini_cluster.cc:1428] Setting key b677ea363bfbd5d2010dd1c4c6abe339
I20260808 07:02:01.145807 31877 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42013
I20260808 07:02:01.145902 31877 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:01.146090 31877 heartbeater.cc:511] Master 127.26.23.190:42013 requested a full tablet report, sending...
I20260808 07:02:01.146696 31579 ts_manager.cc:194] Registered new tserver with Master: 0a4516afd034451a9a0d720c20e94d86 (127.26.23.129:43771)
I20260808 07:02:01.147476 31579 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:44403
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:02:01.170449 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42013
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:01.251293 31882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:01.251482 31882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:01.251515 31882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:01.252614 31882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:01.252660 31882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:01.252696 31882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:01.254076 31882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:01.254316 31882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:01.254515 31882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:01.259238 31892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:01.259277 31896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:01.259269 31891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:01.259443 31882 server_base.cc:1034] running on GCE node
I20260808 07:02:01.259618 31882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:01.259829 31882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:01.260972 31882 hybrid_clock.cc:648] HybridClock initialized: now 1786172521260959 us; error 31 us; skew 500 ppm
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:01.266839 31882 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:02:01.267253 31882 webserver.cc:460] Webserver started at http://127.26.23.130:45181/ using document root <none> and password file <none>
I20260808 07:02:01.267424 31882 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:01.267462 31882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:01.267555 31882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:01.268543 31882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "421eff7f2e8841caa099b708e970879f"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "6c27f59ba2d9ca5899e35ba23d7421ca"
server_key_iv: "5f91edbbdbc15328919eab5e09edc444"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.269024 31882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "421eff7f2e8841caa099b708e970879f"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "6c27f59ba2d9ca5899e35ba23d7421ca"
server_key_iv: "5f91edbbdbc15328919eab5e09edc444"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.270325 31882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:02:01.271060 31906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.271221 31882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:01.271306 31882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "421eff7f2e8841caa099b708e970879f"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "6c27f59ba2d9ca5899e35ba23d7421ca"
server_key_iv: "5f91edbbdbc15328919eab5e09edc444"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.271373 31882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:01.301559 31882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:01.303507 31882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:01.303622 31882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:01.303866 31882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:01.304152 31882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:01.304184 31882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.304206 31882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:01.304229 31882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.309755 31882 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:42153
I20260808 07:02:01.309839 32090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:42153 every 8 connection(s)
I20260808 07:02:01.310096 31882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:01.315362 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 31882
I20260808 07:02:01.315469 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:01.315660 26718 external_mini_cluster.cc:1428] Setting key 460ddfb188f3e072b3c97188175e0be0
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:01.318988 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.310763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:33381 (local address 127.26.23.190:42013)
0808 07:02:01.310816 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:01.310818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:01.311034 (+ 216us) server_negotiation.cc:407] Connection header received
0808 07:02:01.311520 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:01.311521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:01.311536 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:01.311586 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:01.312466 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.312956 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.313906 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.314083 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.314125 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.316349 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:01.316350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:01.316350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:01.316357 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:01.317693 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.318061 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.318062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.318063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.318124 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.318361 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.318362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.318362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.318479 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:01.318537 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:01.318799 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 07:02:01.318897 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:01.319123 32097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.310746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42013 (local address 127.26.23.130:33381)
0808 07:02:01.310918 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:01.310953 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:01.311443 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:01.311646 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:01.311650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:01.312208 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:01.312396 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:01.312401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.313021 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.313021 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:01.313843 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:01.313846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.314146 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.314146 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:01.314283 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.314719 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:01.314727 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:01.316277 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:01.317770 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:01.317776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:01.317778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:01.317983 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:01.318200 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:01.318201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:01.318201 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:01.318302 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:01.318537 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:01.318544 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:01.318676 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 07:02:01.318769 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:02:01.318917 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260808 07:02:01.319548 32094 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42013
I20260808 07:02:01.319648 32094 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:01.319825 32094 heartbeater.cc:511] Master 127.26.23.190:42013 requested a full tablet report, sending...
I20260808 07:02:01.320151 31579 ts_manager.cc:194] Registered new tserver with Master: 421eff7f2e8841caa099b708e970879f (127.26.23.130:42153)
I20260808 07:02:01.320511 31579 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:33381
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:02:01.340996 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42013
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:01.420763 32103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:01.420945 32103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:01.420966 32103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:01.422042 32103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:01.422076 32103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:01.422101 32103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:01.423556 32103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42013
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:01.423735 32103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:01.423910 32103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:01.428608 32108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:01.428669 32112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:01.428625 32110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:01.428840 32103 server_base.cc:1034] running on GCE node
I20260808 07:02:01.429039 32103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:01.429250 32103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:01.430382 32103 hybrid_clock.cc:648] HybridClock initialized: now 1786172521430366 us; error 31 us; skew 500 ppm
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:01.432852 32103 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:02:01.433215 32103 webserver.cc:460] Webserver started at http://127.26.23.131:43531/ using document root <none> and password file <none>
I20260808 07:02:01.433393 32103 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:01.433431 32103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:01.433519 32103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:01.434516 32103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "a213199a88f14ed2871d2877fb889fe0"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "0f46192b9ef53e3d314e4ae03edbe6ba"
server_key_iv: "00cd5e9507556fe4ee96522ff71bef92"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.434808 32103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "a213199a88f14ed2871d2877fb889fe0"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "0f46192b9ef53e3d314e4ae03edbe6ba"
server_key_iv: "00cd5e9507556fe4ee96522ff71bef92"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.436053 32103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:01.436728 32124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.436883 32103 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:01.436967 32103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "a213199a88f14ed2871d2877fb889fe0"
format_stamp: "Formatted at 2026-08-08 07:02:01 on dist-test-slave-zj8q"
server_key: "0f46192b9ef53e3d314e4ae03edbe6ba"
server_key_iv: "00cd5e9507556fe4ee96522ff71bef92"
server_key_version: "encryptionkey@0"
I20260808 07:02:01.437028 32103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:01.448470 32103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:01.450110 32103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:01.450260 32103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:01.450449 32103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:01.450795 32103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:01.450837 32103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.450866 32103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:01.450892 32103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:01.456526 32103 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:40505
I20260808 07:02:01.456593 32286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:40505 every 8 connection(s)
I20260808 07:02:01.456849 32103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:01.465373 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.457486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:45143 (local address 127.26.23.190:42013)
0808 07:02:01.457530 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:01.457532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:01.457743 (+ 211us) server_negotiation.cc:407] Connection header received
0808 07:02:01.458278 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:01.458280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:01.458292 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:01.458340 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:01.459238 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.459747 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.460722 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.460912 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.460967 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.462953 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:01.462954 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:01.462954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:01.462962 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:01.464116 (+ 1154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.464499 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.464500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.464501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.464559 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.464771 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.464771 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.464772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.464883 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:01.464939 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:01.465198 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 07:02:01.465281 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:01.465545 32291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.457447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42013 (local address 127.26.23.131:45143)
0808 07:02:01.457619 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:01.457662 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:01.458180 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:01.458412 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:01.458416 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:01.458951 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:01.459145 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:01.459150 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.459830 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.459831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:01.460639 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:01.460641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.460980 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.460981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:01.461119 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.461531 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:01.461540 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:01.462860 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:01.464207 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:01.464214 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:01.464216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:01.464428 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:01.464615 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:01.464616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:01.464616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:01.464715 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:01.464938 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:01.464944 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:01.465072 (+ 128us) client_negotiation.cc:769] Sending connection context
0808 07:02:01.465165 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 07:02:01.465312 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260808 07:02:01.465745 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 32103
I20260808 07:02:01.465847 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:01.466085 26718 external_mini_cluster.cc:1428] Setting key 256c3301b4df14171b6460ca14f1cc90
I20260808 07:02:01.466179 32287 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42013
I20260808 07:02:01.466295 32287 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:01.466483 32287 heartbeater.cc:511] Master 127.26.23.190:42013 requested a full tablet report, sending...
I20260808 07:02:01.466894 31576 ts_manager.cc:194] Registered new tserver with Master: a213199a88f14ed2871d2877fb889fe0 (127.26.23.131:40505)
I20260808 07:02:01.467303 31576 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:45143
I20260808 07:02:01.477733 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[31510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172521, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:01.500806 31669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:01.494100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54536 (local address 127.26.23.190:42013)
0808 07:02:01.494194 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:01.494196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:01.494341 (+ 145us) server_negotiation.cc:407] Connection header received
0808 07:02:01.494396 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:01.494397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:01.494407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:01.494455 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:01.494987 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.495484 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.496193 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:01.496390 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:01.496443 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:01.498561 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:01.498562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:01.498563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:01.498570 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:01.499655 (+ 1085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.499957 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.499957 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.499958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.500023 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:01.500210 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:01.500210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:01.500211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:01.500382 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:01.500475 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:01.500588 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:02:01.500704 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 07:02:01.501024 31576 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54536
I20260808 07:02:01.501399 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 31682
I20260808 07:02:01.517563 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 31882
I20260808 07:02:01.529649 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 32103
I20260808 07:02:01.540462 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 31530
2026-08-08T07:02:01Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1963 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[32308](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[32308](info): set up 2 sockets
Aug 08 07:02:01 dist-test-slave-zj8q krb5kdc[32308](info): commencing operation
krb5kdc: starting...
W20260808 07:02:02.692220 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:02 dist-test-slave-zj8q krb5kdc[32308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:02.808697 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43393
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:43393
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:02.891297 32328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:02.891566 32328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:02.891606 32328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:02.892769 32328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:02.892807 32328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:02.892827 32328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:02.892844 32328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:02.892859 32328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:02.894392 32328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:43393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:02.894634 32328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:02.894845 32328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:02.899564 32337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:02.899578 32341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:02.899580 32328 server_base.cc:1034] running on GCE node
W20260808 07:02:02.899564 32338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:02.900018 32328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:02.900283 32328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:02.901443 32328 hybrid_clock.cc:648] HybridClock initialized: now 1786172522901410 us; error 45 us; skew 500 ppm
Aug 08 07:02:02 dist-test-slave-zj8q krb5kdc[32308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172522, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:02.903934 32328 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:02.904327 32328 webserver.cc:460] Webserver started at http://127.26.23.190:34587/ using document root <none> and password file <none>
I20260808 07:02:02.904515 32328 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:02.904562 32328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:02.904695 32328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:02.905699 32328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "de49959403c74c04b7692961e093d43e"
format_stamp: "Formatted at 2026-08-08 07:02:02 on dist-test-slave-zj8q"
server_key: "c705101f41a8023aabea8fda4b4eab4b"
server_key_iv: "3e7e99085e3c9301c5340ac3c78f56ca"
server_key_version: "encryptionkey@0"
I20260808 07:02:02.906041 32328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "de49959403c74c04b7692961e093d43e"
format_stamp: "Formatted at 2026-08-08 07:02:02 on dist-test-slave-zj8q"
server_key: "c705101f41a8023aabea8fda4b4eab4b"
server_key_iv: "3e7e99085e3c9301c5340ac3c78f56ca"
server_key_version: "encryptionkey@0"
I20260808 07:02:02.907289 32328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:02:02.907995 32351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:02.908140 32328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:02:02.908223 32328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "de49959403c74c04b7692961e093d43e"
format_stamp: "Formatted at 2026-08-08 07:02:02 on dist-test-slave-zj8q"
server_key: "c705101f41a8023aabea8fda4b4eab4b"
server_key_iv: "3e7e99085e3c9301c5340ac3c78f56ca"
server_key_version: "encryptionkey@0"
I20260808 07:02:02.908289 32328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:02.920773 32328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:02.922528 32328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:02.922658 32328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:02.926555 32328 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:43393
I20260808 07:02:02.926594 32443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:43393 every 8 connection(s)
I20260808 07:02:02.927052 32328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:02.927659 32447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:02.929831 32447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e: Bootstrap starting.
I20260808 07:02:02.930455 32447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:02.930730 32447 log.cc:824] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:02.931372 32447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e: No bootstrap required, opened a new log
I20260808 07:02:02.932925 32447 raft_consensus.cc:348] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49959403c74c04b7692961e093d43e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43393 } }
I20260808 07:02:02.933058 32447 raft_consensus.cc:374] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:02.933091 32447 raft_consensus.cc:729] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de49959403c74c04b7692961e093d43e, State: Initialized, Role: FOLLOWER
I20260808 07:02:02.933236 32447 consensus_queue.cc:260] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49959403c74c04b7692961e093d43e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43393 } }
I20260808 07:02:02.933300 32447 raft_consensus.cc:388] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:02.933331 32447 raft_consensus.cc:482] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:02.933338 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 32328
I20260808 07:02:02.933374 32447 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:02.933446 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:02.933610 26718 external_mini_cluster.cc:1428] Setting key ed2f3a356b82281081c0a5f061648161
I20260808 07:02:02.934391 32447 raft_consensus.cc:504] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49959403c74c04b7692961e093d43e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43393 } }
I20260808 07:02:02.934490 32447 leader_election.cc:302] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de49959403c74c04b7692961e093d43e; no voters:
I20260808 07:02:02.934648 32447 leader_election.cc:288] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:02.934680 32455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:02.934787 32455 raft_consensus.cc:686] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [term 1 LEADER]: Becoming Leader. State: Replica: de49959403c74c04b7692961e093d43e, State: Running, Role: LEADER
I20260808 07:02:02.934867 32455 consensus_queue.cc:237] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49959403c74c04b7692961e093d43e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43393 } }
I20260808 07:02:02.934895 32447 sys_catalog.cc:564] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:02.935217 32455 sys_catalog.cc:455] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [sys.catalog]: SysCatalogTable state changed. Reason: New leader de49959403c74c04b7692961e093d43e. Latest consensus state: current_term: 1 leader_uuid: "de49959403c74c04b7692961e093d43e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49959403c74c04b7692961e093d43e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43393 } } }
I20260808 07:02:02.935302 32455 sys_catalog.cc:458] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:02.935223 32458 sys_catalog.cc:455] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de49959403c74c04b7692961e093d43e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de49959403c74c04b7692961e093d43e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43393 } } }
I20260808 07:02:02.935487 32458 sys_catalog.cc:458] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:02.935528 32466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:02.936074 32466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:02.937701 32466 catalog_manager.cc:1347] Generated new cluster ID: 9a9accdca2f34f88a5d577de08a628a1
I20260808 07:02:02.937754 32466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:02 dist-test-slave-zj8q krb5kdc[32308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:02.943686 32454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:02.934043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38510 (local address 127.26.23.190:43393)
0808 07:02:02.934246 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:02.934264 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:02.934295 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:02:02.934387 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:02.934392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:02.934432 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:02.934545 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:02.935382 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:02.936622 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:02.937542 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:02.938059 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:02.938177 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:02.940285 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:02.940289 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:02.940290 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:02.940300 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:02.941787 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:02.942109 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:02.942112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:02.942112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:02.942267 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:02.942448 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:02.942449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:02.942449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:02.942681 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:02.943371 (+ 690us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:02.943430 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:02:02.943541 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":122,"threads_started":1}
I20260808 07:02:02.952893 32466 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:02.953538 32466 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:02.959442 32466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de49959403c74c04b7692961e093d43e: Generated new TSK 0
I20260808 07:02:02.959591 32466 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:02:02.990998 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43393
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:03.094594 32493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:03.094791 32493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:03.094815 32493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:03.095911 32493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:03.095945 32493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:03.095989 32493 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:03.097536 32493 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:03.097718 32493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:03.097884 32493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:03.102705 32503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:03.102732 32493 server_base.cc:1034] running on GCE node
W20260808 07:02:03.102705 32501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:03.102699 32508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:03.103149 32493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:03.103346 32493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:03.104493 32493 hybrid_clock.cc:648] HybridClock initialized: now 1786172523104478 us; error 28 us; skew 500 ppm
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:03.107034 32493 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:02:03.107412 32493 webserver.cc:460] Webserver started at http://127.26.23.129:41171/ using document root <none> and password file <none>
I20260808 07:02:03.107584 32493 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:03.107623 32493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:03.107710 32493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:03.108748 32493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "487b84843d9a48b788f174a87c69953c"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "fa7c3b6b23ccf0232b29685c394bb6f4"
server_key_iv: "c664c42848df81a2557050f1aab116cc"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.109041 32493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "487b84843d9a48b788f174a87c69953c"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "fa7c3b6b23ccf0232b29685c394bb6f4"
server_key_iv: "c664c42848df81a2557050f1aab116cc"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.110303 32493 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:02:03.111037 32522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.111184 32493 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:03.111289 32493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "487b84843d9a48b788f174a87c69953c"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "fa7c3b6b23ccf0232b29685c394bb6f4"
server_key_iv: "c664c42848df81a2557050f1aab116cc"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.111347 32493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:03.118726 32493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:03.120412 32493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:03.120522 32493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:03.120690 32493 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:03.120981 32493 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:03.121021 32493 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.121039 32493 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:03.121050 32493 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.126821 32493 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:39329
I20260808 07:02:03.126896 32704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:39329 every 8 connection(s)
I20260808 07:02:03.127187 32493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:03.136407 32454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.127917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:58277 (local address 127.26.23.190:43393)
0808 07:02:03.127965 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:03.127967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:03.128171 (+ 204us) server_negotiation.cc:407] Connection header received
0808 07:02:03.129160 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:03.129161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:03.129174 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:03.129222 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:03.129865 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.130438 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.131427 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.131628 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.131687 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.133771 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:03.133773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:03.133773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:03.133780 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:03.135041 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.135463 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.135464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.135464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.135514 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.135732 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.135732 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.135733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.135865 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:03.135919 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:03.136236 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 07:02:03.136329 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:02:03.136559 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.127876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43393 (local address 127.26.23.129:58277)
0808 07:02:03.128021 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:03.128065 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:03.129026 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:03.129306 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:03.129310 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:03.129567 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:03.129767 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:03.129772 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.130530 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.130532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:03.131338 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:03.131341 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.131700 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.131701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:03.131831 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.132258 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:03.132266 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:03.133671 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:03.135120 (+ 1449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:03.135128 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:03.135152 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:03.135401 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:03.135560 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:03.135561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:03.135561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:03.135685 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:03.135949 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:03.135956 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:03.136115 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 07:02:03.136213 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 07:02:03.136356 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260808 07:02:03.136843 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 32493
I20260808 07:02:03.136948 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:03.137079 32705 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43393
I20260808 07:02:03.137121 26718 external_mini_cluster.cc:1428] Setting key d056114109e6da090103427613619cde
I20260808 07:02:03.137172 32705 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:03.137348 32705 heartbeater.cc:511] Master 127.26.23.190:43393 requested a full tablet report, sending...
I20260808 07:02:03.137882 32387 ts_manager.cc:194] Registered new tserver with Master: 487b84843d9a48b788f174a87c69953c (127.26.23.129:39329)
I20260808 07:02:03.138546 32387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:58277
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:02:03.162825 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43393
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:03.244000 32710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:03.244206 32710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:03.244231 32710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:03.245385 32710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:03.245427 32710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:03.245452 32710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:03.246974 32710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:03.247196 32710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:03.247409 32710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:03.252231 32723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:03.252226 32724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:03.252226 32726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:03.252467 32710 server_base.cc:1034] running on GCE node
I20260808 07:02:03.252679 32710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:03.252898 32710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:03.254070 32710 hybrid_clock.cc:648] HybridClock initialized: now 1786172523254050 us; error 31 us; skew 500 ppm
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:03.256693 32710 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:02:03.257151 32710 webserver.cc:460] Webserver started at http://127.26.23.130:42365/ using document root <none> and password file <none>
I20260808 07:02:03.257354 32710 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:03.257402 32710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:03.257550 32710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:03.258617 32710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "87912460c58f4471b3392846f324df5b"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "dd5145215180551d6b731dc36cb2922b"
server_key_iv: "91f76aa157abb2dd014f578fa2ccc8fb"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.258962 32710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "87912460c58f4471b3392846f324df5b"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "dd5145215180551d6b731dc36cb2922b"
server_key_iv: "91f76aa157abb2dd014f578fa2ccc8fb"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.260286 32710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:03.261047 32738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.261205 32710 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:03.261292 32710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "87912460c58f4471b3392846f324df5b"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "dd5145215180551d6b731dc36cb2922b"
server_key_iv: "91f76aa157abb2dd014f578fa2ccc8fb"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.261353 32710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:03.279333 32710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:03.281028 32710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:03.281163 32710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:03.281389 32710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:03.281693 32710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:03.281728 32710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.281755 32710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:03.281772 32710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.287278 32710 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:36011
I20260808 07:02:03.287323 450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:36011 every 8 connection(s)
I20260808 07:02:03.287631 32710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:03.296491 32454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.288338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60591 (local address 127.26.23.190:43393)
0808 07:02:03.288395 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:03.288397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:03.288598 (+ 201us) server_negotiation.cc:407] Connection header received
0808 07:02:03.289592 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:03.289594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:03.289605 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:03.289669 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:03.290345 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.290926 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.291951 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.292217 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.292272 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.294300 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:03.294302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:03.294302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:03.294309 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:03.295387 (+ 1078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.295758 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.295759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.295760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.295807 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.295984 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.295984 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.295984 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.296078 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:03.296122 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:03.296342 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 07:02:03.296426 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:03.296590 454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.288307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43393 (local address 127.26.23.130:60591)
0808 07:02:03.288470 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:03.288512 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:03.289415 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:03.289738 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:03.289742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:03.289981 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:03.290251 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:03.290258 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.291001 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.291002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:03.291859 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:03.291862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.292281 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.292282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:03.292388 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.292828 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:03.292838 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:03.294208 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:03.295453 (+ 1245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:03.295460 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:03.295462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:03.295701 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:03.295852 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:03.295853 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:03.295853 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:03.295943 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:03.296120 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:03.296123 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:03.296230 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 07:02:03.296307 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:02:03.296422 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260808 07:02:03.297073 452 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43393
I20260808 07:02:03.297161 452 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:03.297319 452 heartbeater.cc:511] Master 127.26.23.190:43393 requested a full tablet report, sending...
I20260808 07:02:03.297662 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 32710
I20260808 07:02:03.297724 32387 ts_manager.cc:194] Registered new tserver with Master: 87912460c58f4471b3392846f324df5b (127.26.23.130:36011)
I20260808 07:02:03.297767 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:03.297962 26718 external_mini_cluster.cc:1428] Setting key f77b6f0b7baa7f37415937e94698b801
I20260808 07:02:03.298215 32387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:60591
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:02:03.322625 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43393
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:03.403731 458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:03.403926 458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:03.403957 458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:03.405081 458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:03.405128 458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:03.405162 458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:03.406639 458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:03.406860 458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:03.407058 458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:03.411803 469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:03.411854 466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:03.411970 458 server_base.cc:1034] running on GCE node
W20260808 07:02:03.412007 467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:03.412238 458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:03.412453 458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:03.413584 458 hybrid_clock.cc:648] HybridClock initialized: now 1786172523413568 us; error 33 us; skew 500 ppm
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:03.416013 458 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:02:03.416435 458 webserver.cc:460] Webserver started at http://127.26.23.131:33243/ using document root <none> and password file <none>
I20260808 07:02:03.416627 458 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:03.416669 458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:03.416800 458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:03.417764 458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "9628772ec30f4bf4b2c1ffd6d4d7bda6"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "69b5eaf3ad6b5660206051442e465fab"
server_key_iv: "bd6398e43d25f1692fd6112eea7d7784"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.418082 458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "9628772ec30f4bf4b2c1ffd6d4d7bda6"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "69b5eaf3ad6b5660206051442e465fab"
server_key_iv: "bd6398e43d25f1692fd6112eea7d7784"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.419355 458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:02:03.420013 483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.420153 458 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:02:03.420238 458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "9628772ec30f4bf4b2c1ffd6d4d7bda6"
format_stamp: "Formatted at 2026-08-08 07:02:03 on dist-test-slave-zj8q"
server_key: "69b5eaf3ad6b5660206051442e465fab"
server_key_iv: "bd6398e43d25f1692fd6112eea7d7784"
server_key_version: "encryptionkey@0"
I20260808 07:02:03.420302 458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:03.429004 458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:03.430696 458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:03.430817 458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:03.431005 458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:03.431301 458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:03.431339 458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.431365 458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:03.431391 458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:03.437166 458 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:41841
I20260808 07:02:03.437224 658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:41841 every 8 connection(s)
I20260808 07:02:03.437491 458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:03.445879 32454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.438147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38623 (local address 127.26.23.190:43393)
0808 07:02:03.438214 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:03.438217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:03.438406 (+ 189us) server_negotiation.cc:407] Connection header received
0808 07:02:03.439307 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:03.439308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:03.439321 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:03.439371 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:03.439950 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.440455 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.441415 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.441610 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.441664 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.443605 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:03.443607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:03.443607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:03.443615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:03.444657 (+ 1042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.445007 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.445008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.445009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.445061 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.445270 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.445270 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.445271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.445380 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:03.445437 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:03.445708 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 07:02:03.445789 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:03.446022 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.438111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43393 (local address 127.26.23.131:38623)
0808 07:02:03.438297 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:03.438331 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:03.439206 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:03.439436 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:03.439440 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:03.439690 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:03.439865 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:03.439869 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.440536 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.440537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:03.441335 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:03.441337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.441678 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.441679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:03.441798 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.442205 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:03.442214 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:03.443520 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:03.444728 (+ 1208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:03.444735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:03.444737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:03.444941 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:03.445115 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:03.445116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:03.445116 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:03.445214 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:03.445435 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:03.445442 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:03.445581 (+ 139us) client_negotiation.cc:769] Sending connection context
0808 07:02:03.445673 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 07:02:03.445821 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260808 07:02:03.446503 660 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43393
I20260808 07:02:03.446583 660 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:03.446743 660 heartbeater.cc:511] Master 127.26.23.190:43393 requested a full tablet report, sending...
I20260808 07:02:03.447072 32386 ts_manager.cc:194] Registered new tserver with Master: 9628772ec30f4bf4b2c1ffd6d4d7bda6 (127.26.23.131:41841)
I20260808 07:02:03.447294 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 458
I20260808 07:02:03.447381 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:03.447556 26718 external_mini_cluster.cc:1428] Setting key 439fc0d987417c4a0a4a7b6e046c7581
I20260808 07:02:03.447559 32386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:38623
I20260808 07:02:03.448287 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:02:03.470861 673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.463643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.26.23.129:39329)
0808 07:02:03.463829 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:03.463833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:03.463843 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:03.463868 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:03.463870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:03.463884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:03.463945 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:03.464576 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.465357 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.466087 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.466461 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.466514 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.468493 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:03.468501 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:03.468502 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:03.468508 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:03.469908 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.470232 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.470235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.470235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.470289 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.470435 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.470435 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.470436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.470551 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:03.470653 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:03.470705 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:02:03.470766 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
Aug 08 07:02:03 dist-test-slave-zj8q krb5kdc[32308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:03.477909 32454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:03.472092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38518 (local address 127.26.23.190:43393)
0808 07:02:03.472151 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:03.472153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:03.472161 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:03.472224 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:03.472225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:03.472236 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:03.472284 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:03.472719 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.473192 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.473832 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:03.474023 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:03.474075 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:03.475999 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:03.476001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:03.476001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:03.476008 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:03.477052 (+ 1044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.477329 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.477330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.477330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.477374 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:03.477489 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:03.477490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:03.477490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:03.477611 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:03.477698 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:03.477771 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 07:02:03.477832 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260808 07:02:03.478180 32386 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38518
I20260808 07:02:03.478495 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 32493
I20260808 07:02:03.493618 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 32710
I20260808 07:02:03.504974 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 458
I20260808 07:02:03.520547 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 32328
2026-08-08T07:02:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1980 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:04 dist-test-slave-zj8q krb5kdc[681](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:04 dist-test-slave-zj8q krb5kdc[681](info): set up 2 sockets
Aug 08 07:02:04 dist-test-slave-zj8q krb5kdc[681](info): commencing operation
krb5kdc: starting...
W20260808 07:02:05.914909 26718 mini_kdc.cc:121] Time spent starting KDC: real 2.369s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:05 dist-test-slave-zj8q krb5kdc[681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:06.028306 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40057
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:35257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:40057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:06.110440 704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:06.110647 704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:06.110677 704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:06.111771 704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:06.111806 704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:06.111819 704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:06.111830 704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:06.111841 704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:06.113287 704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:40057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:06.113471 704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:06.113663 704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:06.118371 718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:06.118391 704 server_base.cc:1034] running on GCE node
W20260808 07:02:06.118376 715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:06.118417 714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:06.118827 704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:06.119103 704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:06.120260 704 hybrid_clock.cc:648] HybridClock initialized: now 1786172526120246 us; error 30 us; skew 500 ppm
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:06.122690 704 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:06.123009 704 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:06.123057 704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:06.123188 704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:06.124210 704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "958147ed893f4e889cfdd475f0515566"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "87eac3256edc7d3a0277b57c221303ec"
server_key_iv: "baa0fe9942c375242438d321a963000a"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.124540 704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "958147ed893f4e889cfdd475f0515566"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "87eac3256edc7d3a0277b57c221303ec"
server_key_iv: "baa0fe9942c375242438d321a963000a"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.125771 704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:06.126523 727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.126698 704 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.126796 704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "958147ed893f4e889cfdd475f0515566"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "87eac3256edc7d3a0277b57c221303ec"
server_key_iv: "baa0fe9942c375242438d321a963000a"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.126869 704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:06.142711 704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:06.144348 704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:06.144469 704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:06.148330 704 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:40057
I20260808 07:02:06.148384 801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:40057 every 8 connection(s)
I20260808 07:02:06.148626 704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:06.149562 803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:06.151908 803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566: Bootstrap starting.
I20260808 07:02:06.152482 803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:06.152755 803 log.cc:824] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:06.152778 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 704
I20260808 07:02:06.152865 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:06.153021 26718 external_mini_cluster.cc:1428] Setting key adc0e90f44f65710285d9f56083929c6
I20260808 07:02:06.153457 803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566: No bootstrap required, opened a new log
I20260808 07:02:06.155951 803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958147ed893f4e889cfdd475f0515566" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40057 } }
I20260808 07:02:06.156122 803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:06.156154 803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958147ed893f4e889cfdd475f0515566, State: Initialized, Role: FOLLOWER
I20260808 07:02:06.156267 803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958147ed893f4e889cfdd475f0515566" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40057 } }
I20260808 07:02:06.156337 803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:06.156373 803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:06.156414 803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:06.157035 803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958147ed893f4e889cfdd475f0515566" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40057 } }
I20260808 07:02:06.157131 803 leader_election.cc:302] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 958147ed893f4e889cfdd475f0515566; no voters:
I20260808 07:02:06.157279 803 leader_election.cc:288] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:06.157334 813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:06.157480 813 raft_consensus.cc:686] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [term 1 LEADER]: Becoming Leader. State: Replica: 958147ed893f4e889cfdd475f0515566, State: Running, Role: LEADER
I20260808 07:02:06.157534 803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:06.157642 813 consensus_queue.cc:237] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958147ed893f4e889cfdd475f0515566" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40057 } }
I20260808 07:02:06.158048 816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "958147ed893f4e889cfdd475f0515566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958147ed893f4e889cfdd475f0515566" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40057 } } }
I20260808 07:02:06.158214 816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:06.158638 830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:06.158965 814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 958147ed893f4e889cfdd475f0515566. Latest consensus state: current_term: 1 leader_uuid: "958147ed893f4e889cfdd475f0515566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "958147ed893f4e889cfdd475f0515566" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40057 } } }
I20260808 07:02:06.159029 814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:06.159196 830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:06.160607 830 catalog_manager.cc:1347] Generated new cluster ID: e748694294454073b48562e1e04df77b
I20260808 07:02:06.160657 830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172525, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:06.165439 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.153453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52852 (local address 127.26.23.190:40057)
0808 07:02:06.153649 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.153658 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.153691 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:02:06.154722 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.154732 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.154792 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.154934 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:06.155481 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.156836 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.157888 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.158567 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.158683 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.161574 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:06.161579 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:06.161579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:06.161591 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:06.163519 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.163880 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.163883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.163883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.163989 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.164160 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.164161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.164161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.164459 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:06.164606 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.165064 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.165240 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
I20260808 07:02:06.169615 830 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:06.170114 830 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:06.179441 830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566: Generated new TSK 0
I20260808 07:02:06.179610 830 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:02:06.208377 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40057
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:35257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:06.291955 848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:06.292162 848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:06.292196 848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:06.293331 848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:06.293370 848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:06.293406 848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:06.294983 848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:06.295212 848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:06.295413 848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:06.300345 855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:06.300324 862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:06.300324 859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:06.300365 848 server_base.cc:1034] running on GCE node
I20260808 07:02:06.300794 848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:06.301002 848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:06.302201 848 hybrid_clock.cc:648] HybridClock initialized: now 1786172526302180 us; error 32 us; skew 500 ppm
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:06.307612 848 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:02:06.307938 848 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:06.307991 848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:06.308125 848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:06.309211 848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "faf9c91ab90e449186b685ee7124c8bb"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "0051da1de1d3102e185f51d8ffbfe4b7"
server_key_iv: "9de6e0eb135723f0e25751b0e1e2378f"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.309542 848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "faf9c91ab90e449186b685ee7124c8bb"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "0051da1de1d3102e185f51d8ffbfe4b7"
server_key_iv: "9de6e0eb135723f0e25751b0e1e2378f"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.310806 848 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:02:06.311432 872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.311625 848 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.311717 848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "faf9c91ab90e449186b685ee7124c8bb"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "0051da1de1d3102e185f51d8ffbfe4b7"
server_key_iv: "9de6e0eb135723f0e25751b0e1e2378f"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.311777 848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:06.325155 848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:06.326956 848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:06.327093 848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:06.327291 848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:06.327572 848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:06.327607 848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.327634 848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:06.327656 848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.333401 848 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:34131
I20260808 07:02:06.333426 1041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:34131 every 8 connection(s)
I20260808 07:02:06.333683 848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:06.341866 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.334330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:51081 (local address 127.26.23.190:40057)
0808 07:02:06.334395 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.334397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.334574 (+ 177us) server_negotiation.cc:407] Connection header received
0808 07:02:06.335029 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.335030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.335039 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.335089 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:06.335908 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.336411 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.337347 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.337532 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.337575 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.339496 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:06.339498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:06.339498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:06.339506 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:06.340652 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.341002 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.341003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.341003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.341056 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.341283 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.341284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.341285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.341392 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:06.341448 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.341690 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.341777 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:02:06.342003 1046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.334314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40057 (local address 127.26.23.129:51081)
0808 07:02:06.334464 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.334500 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.334958 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.335154 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.335157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.335400 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:06.335843 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.335848 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.336469 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.336470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.337286 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.337290 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.337591 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.337591 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.337686 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.338033 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:06.338040 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:06.339406 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:06.340725 (+ 1319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:06.340732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:06.340734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:06.340936 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:06.341130 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:06.341130 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:06.341131 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:06.341225 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:06.341447 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:06.341453 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:06.341577 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.341661 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.341804 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260808 07:02:06.342422 1043 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40057
I20260808 07:02:06.342509 1043 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:06.342657 1043 heartbeater.cc:511] Master 127.26.23.190:40057 requested a full tablet report, sending...
I20260808 07:02:06.343226 754 ts_manager.cc:194] Registered new tserver with Master: faf9c91ab90e449186b685ee7124c8bb (127.26.23.129:34131)
I20260808 07:02:06.343663 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 848
I20260808 07:02:06.343752 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:06.343986 26718 external_mini_cluster.cc:1428] Setting key 2a7bf037cbf93a0432757bf2d595ce9d
I20260808 07:02:06.344065 754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:51081
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:02:06.368760 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40057
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:35257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:06.448529 1049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:06.448721 1049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:06.448743 1049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:06.449824 1049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:06.449857 1049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:06.449882 1049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:06.451350 1049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:06.451524 1049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:06.451705 1049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:06.456512 1057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:06.456411 1060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:06.456511 1049 server_base.cc:1034] running on GCE node
W20260808 07:02:06.456408 1058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:06.456910 1049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:06.457175 1049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:06.458320 1049 hybrid_clock.cc:648] HybridClock initialized: now 1786172526458307 us; error 27 us; skew 500 ppm
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:06.460757 1049 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:02:06.461094 1049 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:06.461148 1049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:06.461274 1049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:06.462309 1049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "c9b7f427bfbd455db45a63f4cb85ddbe"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "5d8d090bfda42492cf4c9cf2097ddfa5"
server_key_iv: "368fc5aefd0257263751c2a8b4271c63"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.462647 1049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "c9b7f427bfbd455db45a63f4cb85ddbe"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "5d8d090bfda42492cf4c9cf2097ddfa5"
server_key_iv: "368fc5aefd0257263751c2a8b4271c63"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.463836 1049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:06.464437 1071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.464593 1049 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:06.464679 1049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "c9b7f427bfbd455db45a63f4cb85ddbe"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "5d8d090bfda42492cf4c9cf2097ddfa5"
server_key_iv: "368fc5aefd0257263751c2a8b4271c63"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.464745 1049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:06.486976 1049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:06.488752 1049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:06.488884 1049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:06.489090 1049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:06.489387 1049 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:06.489420 1049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.489449 1049 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:06.489473 1049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.495107 1049 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:44235
I20260808 07:02:06.495157 1262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:44235 every 8 connection(s)
I20260808 07:02:06.495400 1049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:06.503244 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 1049
I20260808 07:02:06.503340 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:06.503516 26718 external_mini_cluster.cc:1428] Setting key 77a72321d78e0eb8e566b6d82357f58f
I20260808 07:02:06.503839 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.496029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:38685 (local address 127.26.23.190:40057)
0808 07:02:06.496076 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.496078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.496262 (+ 184us) server_negotiation.cc:407] Connection header received
0808 07:02:06.496791 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.496792 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.496805 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.496857 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:06.497749 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.498320 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.499334 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.499541 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.499599 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.501476 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:06.501478 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:06.501478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:06.501485 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:06.502577 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.502930 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.502931 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.502931 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.502987 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.503205 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.503206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.503206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.503320 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:06.503376 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.503681 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.503756 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:02:06.504009 1266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.496001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40057 (local address 127.26.23.130:38685)
0808 07:02:06.496148 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.496183 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.496688 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.496921 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.496925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.497186 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:06.497657 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.497662 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.498400 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.498402 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.499253 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.499256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.499611 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.499612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.499729 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.500101 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:06.500108 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:06.501394 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:06.502649 (+ 1255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:06.502656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:06.502658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:06.502863 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:06.503050 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:06.503051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:06.503051 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:06.503149 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:06.503404 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:06.503411 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:06.503542 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.503638 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.503804 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260808 07:02:06.504508 1263 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40057
I20260808 07:02:06.504593 1263 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:06.504765 1263 heartbeater.cc:511] Master 127.26.23.190:40057 requested a full tablet report, sending...
I20260808 07:02:06.505125 754 ts_manager.cc:194] Registered new tserver with Master: c9b7f427bfbd455db45a63f4cb85ddbe (127.26.23.130:44235)
I20260808 07:02:06.505476 754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:38685
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:02:06.526780 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40057
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:35257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:06.606431 1271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:06.606638 1271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:06.606673 1271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:06.607766 1271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:06.607805 1271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:06.607841 1271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:06.609315 1271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40057
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:06.609551 1271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:06.609761 1271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:06.614504 1278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:06.614499 1277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:06.614499 1281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:06.614774 1271 server_base.cc:1034] running on GCE node
I20260808 07:02:06.614988 1271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:06.615197 1271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:06.616338 1271 hybrid_clock.cc:648] HybridClock initialized: now 1786172526616320 us; error 35 us; skew 500 ppm
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:06.618726 1271 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:02:06.619030 1271 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:06.619082 1271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:06.619202 1271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:06.620187 1271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "290fed75e07347f5888270df02a1dece"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "1e9ebcefe9afea5881fa2ce4960bd1f9"
server_key_iv: "92641e6890ef6eba1e7a27762aa36a22"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.620505 1271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "290fed75e07347f5888270df02a1dece"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "1e9ebcefe9afea5881fa2ce4960bd1f9"
server_key_iv: "92641e6890ef6eba1e7a27762aa36a22"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.621716 1271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:06.622435 1287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.622596 1271 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:02:06.622690 1271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "290fed75e07347f5888270df02a1dece"
format_stamp: "Formatted at 2026-08-08 07:02:06 on dist-test-slave-zj8q"
server_key: "1e9ebcefe9afea5881fa2ce4960bd1f9"
server_key_iv: "92641e6890ef6eba1e7a27762aa36a22"
server_key_version: "encryptionkey@0"
I20260808 07:02:06.622747 1271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:06.639043 1271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:06.640967 1271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:06.641108 1271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:06.641307 1271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:06.641609 1271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:06.641644 1271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.641671 1271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:06.641688 1271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:06.647284 1271 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:38017
I20260808 07:02:06.647339 1458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:38017 every 8 connection(s)
I20260808 07:02:06.647588 1271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:06.651341 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 1271
I20260808 07:02:06.651436 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:06.651650 26718 external_mini_cluster.cc:1428] Setting key 34b496c5c385c072abd006cebc21fbd3
Aug 08 07:02:06 dist-test-slave-zj8q krb5kdc[681](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172526, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:06.656352 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.648207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:59219 (local address 127.26.23.190:40057)
0808 07:02:06.648269 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.648271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.648458 (+ 187us) server_negotiation.cc:407] Connection header received
0808 07:02:06.648956 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.648958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.648969 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.649040 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:06.649942 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.650515 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.651568 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.651865 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.651937 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.653989 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:06.653990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:06.653991 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:06.653998 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:06.655092 (+ 1094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.655463 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.655464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.655465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.655524 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.655752 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.655753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.655753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.655868 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:06.655926 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.656179 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.656260 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:02:06.656548 1462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.648200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40057 (local address 127.26.23.131:59219)
0808 07:02:06.648355 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.648388 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.648843 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.649141 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.649145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.649394 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:06.649860 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.649866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.650604 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.650606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.651433 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.651436 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.651956 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.651957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.652083 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.652550 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:06.652560 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:06.653904 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:06.655185 (+ 1281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:06.655191 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:06.655194 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:06.655398 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:06.655575 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:06.655576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:06.655576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:06.655694 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:06.655922 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:06.655928 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:06.656059 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.656144 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.656294 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260808 07:02:06.656970 1460 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40057
I20260808 07:02:06.657052 1460 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:06.657172 1460 heartbeater.cc:511] Master 127.26.23.190:40057 requested a full tablet report, sending...
I20260808 07:02:06.657500 754 ts_manager.cc:194] Registered new tserver with Master: 290fed75e07347f5888270df02a1dece (127.26.23.131:38017)
I20260808 07:02:06.657905 754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:59219
I20260808 07:02:06.663223 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:02:06.669844 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.664410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52858 (local address 127.26.23.190:40057)
0808 07:02:06.664460 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.664462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.664560 (+ 98us) server_negotiation.cc:407] Connection header received
0808 07:02:06.664602 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.664603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.664611 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.664664 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:06.665234 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.665726 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.666438 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.666627 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.666677 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.667745 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:06.667746 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:06.667746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:06.667752 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:06.668921 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.669218 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.669219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.669219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.669276 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:06.669408 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:06.669409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:06.669409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:06.669536 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:06.669656 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.669720 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.669781 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:02:06.671336 754 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:06.672806 754 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:06.678936 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.675134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44548 (local address 127.26.23.129:34131)
0808 07:02:06.675293 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.675299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.675307 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:06.675342 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.675345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.675359 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.675426 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:06.675701 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.676761 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.677783 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.678530 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.678606 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.678665 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.678814 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.678856 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260808 07:02:06.678963 1473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.674776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:38017 (local address 127.0.0.1:50136)
0808 07:02:06.674931 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.674962 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.675030 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.675483 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.675484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.675486 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:06.675519 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.675520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.676477 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.676478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.677762 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.677765 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.678610 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.678611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.678699 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.678716 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.678794 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.678869 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":1,"thread_start_us":56,"threads_started":1}
I20260808 07:02:06.678963 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.674776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:34131 (local address 127.0.0.1:44548)
0808 07:02:06.675011 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.675021 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.675071 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.675522 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.675523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.675525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:06.675578 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.675580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.676845 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.676847 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.677699 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.677702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.678633 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.678634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.678699 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.678716 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.678794 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.678869 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":38,"spinlock_wait_cycles":384,"thread_start_us":67,"threads_started":1}
I20260808 07:02:06.679407 1477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.674938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50136 (local address 127.26.23.131:38017)
0808 07:02:06.675317 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.675320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.675328 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:06.675364 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.675366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.675381 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.675584 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:06.675674 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.676387 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.677847 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.678530 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.678606 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.678665 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.679287 (+ 622us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.679333 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":81,"threads_started":1}
I20260808 07:02:06.679672 946 tablet_service.cc:1467] Processing CreateTablet for tablet 8796131f52fe4418b0f4e82f952d3318 (DEFAULT_TABLE table=test-table [id=2c099eaa39df4927b52e9f81396a4531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:06.680070 946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8796131f52fe4418b0f4e82f952d3318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:06.680020 1355 tablet_service.cc:1467] Processing CreateTablet for tablet 8796131f52fe4418b0f4e82f952d3318 (DEFAULT_TABLE table=test-table [id=2c099eaa39df4927b52e9f81396a4531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:06.680331 1355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8796131f52fe4418b0f4e82f952d3318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:06.682456 1476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.674796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44235 (local address 127.0.0.1:33108)
0808 07:02:06.675148 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.675156 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.675192 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.675368 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.675371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.675373 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:06.675437 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.675439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.676704 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.676705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.677773 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.677775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.682221 (+ 4446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.682222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.682290 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.682294 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.682338 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.682379 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":32,"thread_start_us":45,"threads_started":1}
I20260808 07:02:06.682574 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.675031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33108 (local address 127.26.23.130:44235)
0808 07:02:06.675202 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.675207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.675217 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:06.675256 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.675258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.675274 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.675355 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:06.675504 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.676610 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.678702 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.679589 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.679669 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.679726 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.682378 (+ 2652us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.682423 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260808 07:02:06.683301 1145 tablet_service.cc:1467] Processing CreateTablet for tablet 8796131f52fe4418b0f4e82f952d3318 (DEFAULT_TABLE table=test-table [id=2c099eaa39df4927b52e9f81396a4531]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:06.683511 1481 tablet_bootstrap.cc:492] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: Bootstrap starting.
I20260808 07:02:06.683660 1145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8796131f52fe4418b0f4e82f952d3318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:06.684093 1481 tablet_bootstrap.cc:654] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:06.684592 1481 log.cc:824] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:06.685273 1481 tablet_bootstrap.cc:492] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: No bootstrap required, opened a new log
I20260808 07:02:06.685333 1481 ts_tablet_manager.cc:1397] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:06.686192 1485 tablet_bootstrap.cc:492] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Bootstrap starting.
I20260808 07:02:06.686801 1485 tablet_bootstrap.cc:654] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:06.686784 1486 tablet_bootstrap.cc:492] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Bootstrap starting.
I20260808 07:02:06.687309 1485 log.cc:824] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:06.687346 1481 raft_consensus.cc:348] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.687474 1486 tablet_bootstrap.cc:654] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:06.687517 1481 raft_consensus.cc:374] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:06.687564 1481 raft_consensus.cc:729] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf9c91ab90e449186b685ee7124c8bb, State: Initialized, Role: FOLLOWER
I20260808 07:02:06.687711 1481 consensus_queue.cc:260] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.688000 1481 ts_tablet_manager.cc:1428] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:02:06.688030 1485 tablet_bootstrap.cc:492] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: No bootstrap required, opened a new log
I20260808 07:02:06.688051 1486 log.cc:824] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:06.688081 1485 ts_tablet_manager.cc:1397] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:02:06.688119 1043 heartbeater.cc:503] Master 127.26.23.190:40057 was elected leader, sending a full tablet report...
I20260808 07:02:06.688745 1486 tablet_bootstrap.cc:492] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: No bootstrap required, opened a new log
I20260808 07:02:06.688819 1486 ts_tablet_manager.cc:1397] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:02:06.689960 1485 raft_consensus.cc:348] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.690141 1485 raft_consensus.cc:374] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:06.690205 1485 raft_consensus.cc:729] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9b7f427bfbd455db45a63f4cb85ddbe, State: Initialized, Role: FOLLOWER
I20260808 07:02:06.690318 1485 consensus_queue.cc:260] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.690593 1263 heartbeater.cc:503] Master 127.26.23.190:40057 was elected leader, sending a full tablet report...
I20260808 07:02:06.690716 1486 raft_consensus.cc:348] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.690820 1485 ts_tablet_manager.cc:1428] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:02:06.690860 1486 raft_consensus.cc:374] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:06.690896 1486 raft_consensus.cc:729] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290fed75e07347f5888270df02a1dece, State: Initialized, Role: FOLLOWER
I20260808 07:02:06.690991 1486 consensus_queue.cc:260] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.691233 1486 ts_tablet_manager.cc:1428] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:02:06.691265 1460 heartbeater.cc:503] Master 127.26.23.190:40057 was elected leader, sending a full tablet report...
W20260808 07:02:06.745916 1264 tablet.cc:2369] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:02:06.834376 1044 tablet.cc:2369] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:06.864619 1492 raft_consensus.cc:482] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:06.864768 1492 raft_consensus.cc:504] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.865183 1492 leader_election.cc:288] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf9c91ab90e449186b685ee7124c8bb (127.26.23.129:34131), c9b7f427bfbd455db45a63f4cb85ddbe (127.26.23.130:44235)
I20260808 07:02:06.868044 1462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.865400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44235 (local address 127.26.23.131:33109)
0808 07:02:06.865455 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.865469 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.865542 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.865710 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.865711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.865713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:06.865789 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.865791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.866422 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.866423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.867241 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.867244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.867803 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.867804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.867882 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.867885 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.867932 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.867968 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:02:06.868044 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.865540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:33109 (local address 127.26.23.130:44235)
0808 07:02:06.865603 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.865605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.865613 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:06.865641 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.865642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.865650 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.865697 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:06.865849 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.866345 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.867319 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.867696 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.867797 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.867808 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.867946 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.867981 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:02:06.868229 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.865462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:48175 (local address 127.26.23.129:34131)
0808 07:02:06.865539 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.865542 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.865801 (+ 259us) server_negotiation.cc:407] Connection header received
0808 07:02:06.865855 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.865856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.865865 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.865910 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:06.866051 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.866596 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.867498 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.867923 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.867986 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.867994 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.868120 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.868169 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:02:06.868227 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.865400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:34131 (local address 127.26.23.131:48175)
0808 07:02:06.865731 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.865740 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:06.865800 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:06.865912 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:06.865912 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:06.865933 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:06.865996 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.865998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.866681 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.866682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.867422 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:06.867425 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.867995 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.867996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:06.868056 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.868059 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:06.868103 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:02:06.868141 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":168,"thread_start_us":100,"threads_started":1}
I20260808 07:02:06.868443 1178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8796131f52fe4418b0f4e82f952d3318" candidate_uuid: "290fed75e07347f5888270df02a1dece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" is_pre_election: true
I20260808 07:02:06.868610 1178 raft_consensus.cc:2454] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290fed75e07347f5888270df02a1dece in term 0.
I20260808 07:02:06.868625 974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8796131f52fe4418b0f4e82f952d3318" candidate_uuid: "290fed75e07347f5888270df02a1dece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf9c91ab90e449186b685ee7124c8bb" is_pre_election: true
I20260808 07:02:06.868789 974 raft_consensus.cc:2454] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290fed75e07347f5888270df02a1dece in term 0.
I20260808 07:02:06.868826 1290 leader_election.cc:302] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290fed75e07347f5888270df02a1dece, c9b7f427bfbd455db45a63f4cb85ddbe; no voters:
I20260808 07:02:06.869009 1492 raft_consensus.cc:2781] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:06.869055 1492 raft_consensus.cc:482] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:06.869071 1492 raft_consensus.cc:3037] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:06.869752 1492 raft_consensus.cc:504] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.869871 1492 leader_election.cc:288] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [CANDIDATE]: Term 1 election: Requested vote from peers faf9c91ab90e449186b685ee7124c8bb (127.26.23.129:34131), c9b7f427bfbd455db45a63f4cb85ddbe (127.26.23.130:44235)
I20260808 07:02:06.870061 974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8796131f52fe4418b0f4e82f952d3318" candidate_uuid: "290fed75e07347f5888270df02a1dece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf9c91ab90e449186b685ee7124c8bb"
I20260808 07:02:06.870039 1178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8796131f52fe4418b0f4e82f952d3318" candidate_uuid: "290fed75e07347f5888270df02a1dece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe"
I20260808 07:02:06.870138 974 raft_consensus.cc:3037] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:06.870141 1178 raft_consensus.cc:3037] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:06.870893 974 raft_consensus.cc:2454] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290fed75e07347f5888270df02a1dece in term 1.
I20260808 07:02:06.870946 1178 raft_consensus.cc:2454] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290fed75e07347f5888270df02a1dece in term 1.
I20260808 07:02:06.871095 1290 leader_election.cc:302] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290fed75e07347f5888270df02a1dece, c9b7f427bfbd455db45a63f4cb85ddbe; no voters:
I20260808 07:02:06.871235 1492 raft_consensus.cc:2781] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:06.871381 1492 raft_consensus.cc:686] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 1 LEADER]: Becoming Leader. State: Replica: 290fed75e07347f5888270df02a1dece, State: Running, Role: LEADER
I20260808 07:02:06.871505 1492 consensus_queue.cc:237] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } }
I20260808 07:02:06.872313 753 catalog_manager.cc:5495] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece reported cstate change: term changed from 0 to 1, leader changed from <none> to 290fed75e07347f5888270df02a1dece (127.26.23.131). New cstate: current_term: 1 leader_uuid: "290fed75e07347f5888270df02a1dece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "290fed75e07347f5888270df02a1dece" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 } health_report { overall_health: UNKNOWN } } }
W20260808 07:02:06.898065 1461 tablet.cc:2369] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:06.903335 1477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.901077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50148 (local address 127.26.23.131:38017)
0808 07:02:06.901155 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:06.901157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:06.901166 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:06.901200 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:06.901201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:06.901219 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:06.901277 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:06.901404 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.901868 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.902626 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:06.902811 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:06.902864 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:06.903012 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:06.903118 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:06.903189 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:06.903227 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:02:06.903247 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 07:02:06.904999 974 raft_consensus.cc:1261] T 8796131f52fe4418b0f4e82f952d3318 P faf9c91ab90e449186b685ee7124c8bb [term 1 FOLLOWER]: Refusing update from remote peer 290fed75e07347f5888270df02a1dece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:06.904999 1178 raft_consensus.cc:1261] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 1 FOLLOWER]: Refusing update from remote peer 290fed75e07347f5888270df02a1dece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:06.905339 1492 consensus_queue.cc:1035] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9b7f427bfbd455db45a63f4cb85ddbe" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:06.905478 1494 consensus_queue.cc:1035] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf9c91ab90e449186b685ee7124c8bb" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:06.907754 1500 mvcc.cc:205] Tried to move back new op lower bound from 7316162670200193024 to 7316162670066266112. Current Snapshot: MvccSnapshot[applied={T|T < 7316162670200193024}]
I20260808 07:02:06.908841 1505 mvcc.cc:205] Tried to move back new op lower bound from 7316162670200193024 to 7316162670066266112. Current Snapshot: MvccSnapshot[applied={T|T < 7316162670200193024 or (T in {7316162670200193024})}]
I20260808 07:02:06.910140 754 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:06.910251 754 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:06.910900 754 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 958147ed893f4e889cfdd475f0515566: Sending DeleteTablet for 3 replicas of tablet 8796131f52fe4418b0f4e82f952d3318
I20260808 07:02:06.911232 946 tablet_service.cc:1514] Processing DeleteTablet for tablet 8796131f52fe4418b0f4e82f952d3318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:06 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:44548
I20260808 07:02:06.911257 1355 tablet_service.cc:1514] Processing DeleteTablet for tablet 8796131f52fe4418b0f4e82f952d3318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:06 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:50136
I20260808 07:02:06.911511 1145 tablet_service.cc:1514] Processing DeleteTablet for tablet 8796131f52fe4418b0f4e82f952d3318 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:06 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:33108
I20260808 07:02:06.911593 1525 tablet_replica.cc:330] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: stopping tablet replica
I20260808 07:02:06.911684 1525 raft_consensus.cc:2229] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:06.911692 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 848
I20260808 07:02:06.915681 1525 raft_consensus.cc:2258] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:06.919530 1525 ts_tablet_manager.cc:1905] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:06.921062 1526 tablet_replica.cc:330] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: stopping tablet replica
I20260808 07:02:06.921166 1526 raft_consensus.cc:2229] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:06.921273 1526 raft_consensus.cc:2258] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:06.921404 1525 ts_tablet_manager.cc:1918] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:06.921455 1525 log.cc:1196] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/8796131f52fe4418b0f4e82f952d3318
I20260808 07:02:06.921664 1525 ts_tablet_manager.cc:1939] T 8796131f52fe4418b0f4e82f952d3318 P 290fed75e07347f5888270df02a1dece: Deleting consensus metadata
I20260808 07:02:06.921999 728 catalog_manager.cc:4841] TS 290fed75e07347f5888270df02a1dece (127.26.23.131:38017): tablet 8796131f52fe4418b0f4e82f952d3318 (table test-table [id=2c099eaa39df4927b52e9f81396a4531]) successfully deleted
I20260808 07:02:06.926867 1526 ts_tablet_manager.cc:1905] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:06.928589 1526 ts_tablet_manager.cc:1918] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:06.928694 1526 log.cc:1196] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/8796131f52fe4418b0f4e82f952d3318
I20260808 07:02:06.928962 1526 ts_tablet_manager.cc:1939] T 8796131f52fe4418b0f4e82f952d3318 P c9b7f427bfbd455db45a63f4cb85ddbe: Deleting consensus metadata
I20260808 07:02:06.929407 730 catalog_manager.cc:4841] TS c9b7f427bfbd455db45a63f4cb85ddbe (127.26.23.130:44235): tablet 8796131f52fe4418b0f4e82f952d3318 (table test-table [id=2c099eaa39df4927b52e9f81396a4531]) successfully deleted
W20260808 07:02:06.932860 729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:34131 (error 108)
I20260808 07:02:06.933332 1476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:06.933205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:34131 (local address 127.0.0.1:44564)
0808 07:02:06.933257 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:06.933296 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:34131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:02:06.933411 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 1049
W20260808 07:02:06.948357 729 catalog_manager.cc:4584] TS faf9c91ab90e449186b685ee7124c8bb (127.26.23.129:34131): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8796131f52fe4418b0f4e82f952d3318: Network error: Client connection negotiation failed: client connection to 127.26.23.129:34131: connect: Connection refused (error 111)
I20260808 07:02:06.961297 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 1271
I20260808 07:02:06.975127 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 704
2026-08-08T07:02:06Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3454 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T07:02:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:06Z Disabled control of system clock
I20260808 07:02:07.007275 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:37321
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:37321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:02:07.086481 1532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:07.086683 1532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:07.086704 1532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:07.087787 1532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:07.087821 1532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:07.087833 1532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:07.087844 1532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:07.087855 1532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:07.089154 1532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:37321
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:37321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:07.089341 1532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:07.089588 1532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:07.094313 1538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.094318 1540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.094348 1543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:07.094483 1532 server_base.cc:1034] running on GCE node
I20260808 07:02:07.094878 1532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:07.095170 1532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:07.096335 1532 hybrid_clock.cc:648] HybridClock initialized: now 1786172527096320 us; error 25 us; skew 500 ppm
I20260808 07:02:07.097543 1532 webserver.cc:460] Webserver started at http://127.26.23.190:41109/ using document root <none> and password file <none>
I20260808 07:02:07.097801 1532 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:07.097853 1532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:07.097977 1532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:07.099064 1532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "249455718bfd4b0190033837ec787e90"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "c2ae49c7b29f1a22752b52e7db2ce22f"
server_key_iv: "f0d257b88904f72135a81290efcd51ec"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.099412 1532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "249455718bfd4b0190033837ec787e90"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "c2ae49c7b29f1a22752b52e7db2ce22f"
server_key_iv: "f0d257b88904f72135a81290efcd51ec"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.100769 1532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:07.101439 1553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.101583 1532 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:07.101676 1532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "249455718bfd4b0190033837ec787e90"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "c2ae49c7b29f1a22752b52e7db2ce22f"
server_key_iv: "f0d257b88904f72135a81290efcd51ec"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.101743 1532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:07.105011 1532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:07.105259 1532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:07.105377 1532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:07.109140 1532 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:37321
I20260808 07:02:07.109186 1625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:37321 every 8 connection(s)
I20260808 07:02:07.109476 1532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:07.110100 1627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:07.111079 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 1532
I20260808 07:02:07.111173 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:07.111346 26718 external_mini_cluster.cc:1428] Setting key e88463ed98b530085f0178cdf106c805
I20260808 07:02:07.113368 1627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90: Bootstrap starting.
I20260808 07:02:07.113668 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.111857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45730 (local address 127.26.23.190:37321)
0808 07:02:07.112030 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.112038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.112061 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:02:07.112477 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.112484 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.112521 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.112640 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.113269 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.113273 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.113273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.113276 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.113315 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.113324 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.113376 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.113461 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.113519 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":66,"threads_started":1}
I20260808 07:02:07.114073 1627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:07.114413 1627 log.cc:824] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:07.115031 1627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90: No bootstrap required, opened a new log
I20260808 07:02:07.116341 1627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249455718bfd4b0190033837ec787e90" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 37321 } }
I20260808 07:02:07.116472 1627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:07.116492 1627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 249455718bfd4b0190033837ec787e90, State: Initialized, Role: FOLLOWER
I20260808 07:02:07.116608 1627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249455718bfd4b0190033837ec787e90" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 37321 } }
I20260808 07:02:07.116688 1627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:07.116721 1627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:07.116767 1627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:07.117280 1627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249455718bfd4b0190033837ec787e90" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 37321 } }
I20260808 07:02:07.117367 1627 leader_election.cc:302] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 249455718bfd4b0190033837ec787e90; no voters:
I20260808 07:02:07.117481 1627 leader_election.cc:288] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:07.117723 1637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:07.117723 1627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:07.117866 1637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [term 1 LEADER]: Becoming Leader. State: Replica: 249455718bfd4b0190033837ec787e90, State: Running, Role: LEADER
I20260808 07:02:07.117961 1637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249455718bfd4b0190033837ec787e90" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 37321 } }
I20260808 07:02:07.118336 1641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 249455718bfd4b0190033837ec787e90. Latest consensus state: current_term: 1 leader_uuid: "249455718bfd4b0190033837ec787e90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249455718bfd4b0190033837ec787e90" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 37321 } } }
I20260808 07:02:07.118432 1641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:07.118659 1649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:07.118640 1638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "249455718bfd4b0190033837ec787e90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "249455718bfd4b0190033837ec787e90" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 37321 } } }
I20260808 07:02:07.118948 1638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:07.119159 1649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:07.120553 1649 catalog_manager.cc:1347] Generated new cluster ID: 13ead8afa9704423b852a9fc996a553e
I20260808 07:02:07.120596 1649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:07.129338 1649 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:07.129482 1649 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:07.132649 1649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90: Generated new TSK 0
I20260808 07:02:07.132810 1649 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:02:07.138368 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:37321
--builtin_ntp_servers=127.26.23.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:02:07.221936 1662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:07.222139 1662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:07.222184 1662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:07.223345 1662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:07.223384 1662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:07.223409 1662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:07.224736 1662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:37321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:07.224951 1662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:07.225234 1662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:07.230051 1676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.230060 1670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.230070 1672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:07.230396 1662 server_base.cc:1034] running on GCE node
I20260808 07:02:07.230576 1662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:07.230793 1662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:07.231938 1662 hybrid_clock.cc:648] HybridClock initialized: now 1786172527231926 us; error 29 us; skew 500 ppm
I20260808 07:02:07.233147 1662 webserver.cc:460] Webserver started at http://127.26.23.129:34407/ using document root <none> and password file <none>
I20260808 07:02:07.233369 1662 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:07.233417 1662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:07.233542 1662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:07.234668 1662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "4bf24d29b1cc4b668807b38102a1d264"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "22fa141c5064afe0888da04e306f6fb6"
server_key_iv: "4c64370ef2e96a4948068196975abbdd"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.235011 1662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "4bf24d29b1cc4b668807b38102a1d264"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "22fa141c5064afe0888da04e306f6fb6"
server_key_iv: "4c64370ef2e96a4948068196975abbdd"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.236282 1662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:07.237015 1685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.237180 1662 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:07.237268 1662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "4bf24d29b1cc4b668807b38102a1d264"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "22fa141c5064afe0888da04e306f6fb6"
server_key_iv: "4c64370ef2e96a4948068196975abbdd"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.237331 1662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:07.240610 1662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:07.240869 1662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:07.240986 1662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:07.241175 1662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:07.241496 1662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:07.241533 1662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.241560 1662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:07.241585 1662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.247393 1662 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:45781
I20260808 07:02:07.247449 1866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:45781 every 8 connection(s)
I20260808 07:02:07.247750 1662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:02:07.250468 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.248410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:56329 (local address 127.26.23.190:37321)
0808 07:02:07.248462 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.248465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.248703 (+ 238us) server_negotiation.cc:407] Connection header received
0808 07:02:07.249158 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.249159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.249165 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.249215 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.250279 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.250280 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.250280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.250284 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.250299 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.250302 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.250345 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.250400 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.250411 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:07.250623 1872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.248399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:37321 (local address 127.26.23.129:56329)
0808 07:02:07.248577 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.248612 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.249063 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.249268 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.249271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.249278 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.250096 (+ 818us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.250097 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.250144 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.250195 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.250345 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.250348 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.250350 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.250399 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.250445 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":89,"threads_started":1}
I20260808 07:02:07.251073 1867 heartbeater.cc:347] Connected to a master server at 127.26.23.190:37321
I20260808 07:02:07.251159 1867 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:07.251298 1867 heartbeater.cc:511] Master 127.26.23.190:37321 requested a full tablet report, sending...
I20260808 07:02:07.251770 1579 ts_manager.cc:194] Registered new tserver with Master: 4bf24d29b1cc4b668807b38102a1d264 (127.26.23.129:45781)
I20260808 07:02:07.255030 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 1662
I20260808 07:02:07.255112 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:07.255301 26718 external_mini_cluster.cc:1428] Setting key 08d03e367a4e85caa2a78a641a45459c
I20260808 07:02:07.256138 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:37321
--builtin_ntp_servers=127.26.23.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:02:07.337250 1873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:07.337446 1873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:07.337477 1873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:07.338641 1873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:07.338690 1873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:07.338724 1873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:07.340097 1873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:37321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:07.340317 1873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:07.340577 1873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:07.345396 1881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.345412 1883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.345412 1886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:07.345656 1873 server_base.cc:1034] running on GCE node
I20260808 07:02:07.345844 1873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:07.346076 1873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:07.347227 1873 hybrid_clock.cc:648] HybridClock initialized: now 1786172527347204 us; error 36 us; skew 500 ppm
I20260808 07:02:07.348727 1873 webserver.cc:460] Webserver started at http://127.26.23.130:45275/ using document root <none> and password file <none>
I20260808 07:02:07.349010 1873 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:07.349077 1873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:07.349218 1873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:07.350298 1873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "dda5755633244ecaab8a679067c6f947"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "cddac954959f2dcc68e38d224d4dfd6b"
server_key_iv: "887aaac841f0c6a3413947eb3080f60f"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.350643 1873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "dda5755633244ecaab8a679067c6f947"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "cddac954959f2dcc68e38d224d4dfd6b"
server_key_iv: "887aaac841f0c6a3413947eb3080f60f"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.351866 1873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:07.352499 1892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.352670 1873 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:07.352743 1873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "dda5755633244ecaab8a679067c6f947"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "cddac954959f2dcc68e38d224d4dfd6b"
server_key_iv: "887aaac841f0c6a3413947eb3080f60f"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.352813 1873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:07.356108 1873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:07.356355 1873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:07.356472 1873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:07.356673 1873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:07.356949 1873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:07.356981 1873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.357007 1873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:07.357031 1873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.362353 1873 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:39411
I20260808 07:02:07.362412 2051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:39411 every 8 connection(s)
I20260808 07:02:07.362684 1873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:07.365418 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.363309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:52237 (local address 127.26.23.190:37321)
0808 07:02:07.363348 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.363350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.363611 (+ 261us) server_negotiation.cc:407] Connection header received
0808 07:02:07.364070 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.364071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.364077 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.364143 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.365228 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.365230 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.365230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.365234 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.365249 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.365253 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.365296 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.365351 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.365363 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:02:07.365639 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.363281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:37321 (local address 127.26.23.130:52237)
0808 07:02:07.363461 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.363498 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.363949 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.364238 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.364242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.364251 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.365087 (+ 836us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.365087 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.365114 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.365141 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.365301 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.365304 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.365306 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.365351 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.365394 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260808 07:02:07.366130 2052 heartbeater.cc:347] Connected to a master server at 127.26.23.190:37321
I20260808 07:02:07.366236 2052 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:07.366374 2052 heartbeater.cc:511] Master 127.26.23.190:37321 requested a full tablet report, sending...
I20260808 07:02:07.366707 1579 ts_manager.cc:194] Registered new tserver with Master: dda5755633244ecaab8a679067c6f947 (127.26.23.130:39411)
I20260808 07:02:07.371138 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 1873
I20260808 07:02:07.371220 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:07.371356 26718 external_mini_cluster.cc:1428] Setting key e7f0e37ebfb507e642c9a7086767d741
I20260808 07:02:07.372169 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:37321
--builtin_ntp_servers=127.26.23.148:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 07:02:07.452208 2057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:07.452406 2057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:07.452435 2057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:07.453558 2057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:07.453598 2057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:07.453637 2057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:07.454968 2057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:37321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:07.455209 2057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:07.455487 2057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:07.460296 2068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.460306 2070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.460316 2067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:07.460453 2057 server_base.cc:1034] running on GCE node
I20260808 07:02:07.460698 2057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:07.460924 2057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:07.462059 2057 hybrid_clock.cc:648] HybridClock initialized: now 1786172527462047 us; error 34 us; skew 500 ppm
I20260808 07:02:07.463253 2057 webserver.cc:460] Webserver started at http://127.26.23.131:34471/ using document root <none> and password file <none>
I20260808 07:02:07.463474 2057 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:07.463519 2057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:07.463647 2057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:07.464664 2057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "4856b97a548a4159bd011d22f1132c5e"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "f5a8770f12ad33d13056eaa5f37cca57"
server_key_iv: "5d9feaccbaafce649e4f2b48d28850bb"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.464993 2057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "4856b97a548a4159bd011d22f1132c5e"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "f5a8770f12ad33d13056eaa5f37cca57"
server_key_iv: "5d9feaccbaafce649e4f2b48d28850bb"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.466267 2057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:07.467047 2082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.467204 2057 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:07.467289 2057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "4856b97a548a4159bd011d22f1132c5e"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "f5a8770f12ad33d13056eaa5f37cca57"
server_key_iv: "5d9feaccbaafce649e4f2b48d28850bb"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.467355 2057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:07.470623 2057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:07.470866 2057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:07.470981 2057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:07.471167 2057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:07.471441 2057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:07.471472 2057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.471498 2057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:07.471521 2057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.476853 2057 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:45479
I20260808 07:02:07.476907 2275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:45479 every 8 connection(s)
I20260808 07:02:07.477198 2057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:07.479820 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.477824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:35843 (local address 127.26.23.190:37321)
0808 07:02:07.477871 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.477874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.478089 (+ 215us) server_negotiation.cc:407] Connection header received
0808 07:02:07.478575 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.478576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.478582 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.478634 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.479635 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.479636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.479636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.479640 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.479655 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.479659 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.479702 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.479752 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.479763 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:07.479985 2280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.477808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:37321 (local address 127.26.23.131:35843)
0808 07:02:07.477966 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.477998 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.478485 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.478685 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.478688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.478696 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.479502 (+ 806us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.479502 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.479529 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.479556 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.479702 (+ 146us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.479704 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.479706 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.479755 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.479802 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":72,"threads_started":1}
I20260808 07:02:07.480455 2277 heartbeater.cc:347] Connected to a master server at 127.26.23.190:37321
I20260808 07:02:07.480528 2277 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:07.480643 2277 heartbeater.cc:511] Master 127.26.23.190:37321 requested a full tablet report, sending...
I20260808 07:02:07.480950 1579 ts_manager.cc:194] Registered new tserver with Master: 4856b97a548a4159bd011d22f1132c5e (127.26.23.131:45479)
I20260808 07:02:07.487099 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 2057
I20260808 07:02:07.487183 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:07.487352 26718 external_mini_cluster.cc:1428] Setting key df825d25388719fb1a7cc08fd956e07d
I20260808 07:02:07.488080 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:02:07.490350 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.489372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45740 (local address 127.26.23.190:37321)
0808 07:02:07.489418 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.489420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.489510 (+ 90us) server_negotiation.cc:407] Connection header received
0808 07:02:07.489580 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.489581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.489586 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.489638 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.490121 (+ 483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.490122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.490123 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.490127 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.490141 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.490144 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.490215 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.490268 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.490281 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:02:07.491801 1579 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:07.493281 1579 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:07.496992 2289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.495138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45479 (local address 127.0.0.1:58416)
0808 07:02:07.495440 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.495480 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.495556 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.495699 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.495704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.495710 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.496257 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.496257 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.496274 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.496297 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.496836 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.496843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.496846 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.496909 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.496924 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":66,"threads_started":1}
I20260808 07:02:07.497014 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.495275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.26.23.131:45479)
0808 07:02:07.495445 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.495449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.495560 (+ 111us) server_negotiation.cc:407] Connection header received
0808 07:02:07.495609 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.495611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.495620 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.495682 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.496701 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.496709 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.496709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.496713 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.496747 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.496769 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.496829 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.496924 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.496940 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
I20260808 07:02:07.497211 2299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.495468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53194 (local address 127.26.23.130:39411)
0808 07:02:07.495665 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.495669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.496277 (+ 608us) server_negotiation.cc:407] Connection header received
0808 07:02:07.496374 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.496385 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.496396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.496473 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.496880 (+ 407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.496888 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.496889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.496893 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.496925 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.496951 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.497004 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.497107 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.497126 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":89,"threads_started":1}
I20260808 07:02:07.497378 2295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.495348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:39411 (local address 127.0.0.1:53194)
0808 07:02:07.496207 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.496217 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.496300 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.496480 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.496480 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.496482 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.496799 (+ 317us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.496799 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.496806 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.496816 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.497030 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.497031 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.497031 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.497305 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.497319 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"thread_start_us":67,"threads_started":1}
I20260808 07:02:07.497916 2155 tablet_service.cc:1467] Processing CreateTablet for tablet ca48ddaed38f4d478cb040fe35f92603 (DEFAULT_TABLE table=test-table [id=17172d52101945f98335570e11c28668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:07.497999 1954 tablet_service.cc:1467] Processing CreateTablet for tablet ca48ddaed38f4d478cb040fe35f92603 (DEFAULT_TABLE table=test-table [id=17172d52101945f98335570e11c28668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:07.498317 2155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca48ddaed38f4d478cb040fe35f92603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:07.498327 1954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca48ddaed38f4d478cb040fe35f92603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:07.501483 2300 tablet_bootstrap.cc:492] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Bootstrap starting.
I20260808 07:02:07.501731 2291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.495152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:45781 (local address 127.0.0.1:37276)
0808 07:02:07.495497 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.495507 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.495554 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.496118 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.496119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.496122 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.496886 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.496887 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.496894 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.496906 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.501609 (+ 4703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.501610 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.501611 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.501656 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.501669 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":93,"threads_started":1}
I20260808 07:02:07.501788 2293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.495260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.26.23.129:45781)
0808 07:02:07.495753 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.495757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.495765 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:07.495792 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.495794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.495804 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.495885 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.496988 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.496995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.496995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.497000 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.497030 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.501514 (+ 4484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.501582 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.501679 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.501696 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":76,"threads_started":1}
I20260808 07:02:07.502205 2300 tablet_bootstrap.cc:654] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:07.502266 2301 tablet_bootstrap.cc:492] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Bootstrap starting.
I20260808 07:02:07.502382 1760 tablet_service.cc:1467] Processing CreateTablet for tablet ca48ddaed38f4d478cb040fe35f92603 (DEFAULT_TABLE table=test-table [id=17172d52101945f98335570e11c28668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:07.502530 2300 log.cc:824] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:07.502696 1760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca48ddaed38f4d478cb040fe35f92603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:07.502919 2301 tablet_bootstrap.cc:654] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:07.503234 2301 log.cc:824] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:07.503265 2300 tablet_bootstrap.cc:492] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: No bootstrap required, opened a new log
I20260808 07:02:07.503321 2300 ts_tablet_manager.cc:1397] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:02:07.504036 2301 tablet_bootstrap.cc:492] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: No bootstrap required, opened a new log
I20260808 07:02:07.504103 2301 ts_tablet_manager.cc:1397] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:07.505335 2304 tablet_bootstrap.cc:492] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264: Bootstrap starting.
I20260808 07:02:07.505715 2300 raft_consensus.cc:348] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.505889 2300 raft_consensus.cc:374] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:07.505913 2304 tablet_bootstrap.cc:654] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:07.505926 2300 raft_consensus.cc:729] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4856b97a548a4159bd011d22f1132c5e, State: Initialized, Role: FOLLOWER
I20260808 07:02:07.506146 2300 consensus_queue.cc:260] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.506240 2304 log.cc:824] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:07.506441 2300 ts_tablet_manager.cc:1428] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 07:02:07.506560 2277 heartbeater.cc:503] Master 127.26.23.190:37321 was elected leader, sending a full tablet report...
I20260808 07:02:07.506799 2301 raft_consensus.cc:348] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.506929 2301 raft_consensus.cc:374] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:07.506937 2304 tablet_bootstrap.cc:492] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264: No bootstrap required, opened a new log
I20260808 07:02:07.506970 2301 raft_consensus.cc:729] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda5755633244ecaab8a679067c6f947, State: Initialized, Role: FOLLOWER
I20260808 07:02:07.506994 2304 ts_tablet_manager.cc:1397] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:02:07.507093 2301 consensus_queue.cc:260] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.507361 2301 ts_tablet_manager.cc:1428] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:02:07.507447 2052 heartbeater.cc:503] Master 127.26.23.190:37321 was elected leader, sending a full tablet report...
I20260808 07:02:07.509019 2304 raft_consensus.cc:348] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.509135 2304 raft_consensus.cc:374] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:07.509166 2304 raft_consensus.cc:729] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bf24d29b1cc4b668807b38102a1d264, State: Initialized, Role: FOLLOWER
I20260808 07:02:07.509270 2304 consensus_queue.cc:260] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.509505 2304 ts_tablet_manager.cc:1428] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 07:02:07.509557 1867 heartbeater.cc:503] Master 127.26.23.190:37321 was elected leader, sending a full tablet report...
W20260808 07:02:07.613188 2053 tablet.cc:2369] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:07.620500 2309 raft_consensus.cc:482] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:07.620635 2309 raft_consensus.cc:504] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.620990 2309 leader_election.cc:288] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bf24d29b1cc4b668807b38102a1d264 (127.26.23.129:45781), 4856b97a548a4159bd011d22f1132c5e (127.26.23.131:45479)
I20260808 07:02:07.622256 2293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.621327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:44679 (local address 127.26.23.129:45781)
0808 07:02:07.621376 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.621377 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.621388 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:07.621421 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.621422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.621429 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.621484 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.622009 (+ 525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.622010 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.622011 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.622015 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.622034 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.622039 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.622087 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.622173 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.622188 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:02:07.622256 2055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.621165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:45781 (local address 127.26.23.130:44679)
0808 07:02:07.621215 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.621228 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.621277 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.621492 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.621493 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.621496 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.621916 (+ 420us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.621917 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.621924 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.621936 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.622088 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.622089 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.622090 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.622173 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.622188 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:02:07.622388 2312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.621167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45479 (local address 127.26.23.130:60583)
0808 07:02:07.621371 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.621381 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.621441 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.621570 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.621571 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.621573 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:07.622044 (+ 471us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:07.622044 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:07.622051 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:07.622064 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:07.622251 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:07.622252 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:07.622252 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 07:02:07.622292 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 07:02:07.622305 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":35,"thread_start_us":108,"threads_started":1}
I20260808 07:02:07.622385 2294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.621317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60583 (local address 127.26.23.131:45479)
0808 07:02:07.621360 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.621362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.621439 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:02:07.621503 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.621504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.621509 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.621565 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.622169 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.622171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.622171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.622176 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.622194 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.622198 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.622250 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.622309 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.622322 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:07.622730 2188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca48ddaed38f4d478cb040fe35f92603" candidate_uuid: "dda5755633244ecaab8a679067c6f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4856b97a548a4159bd011d22f1132c5e" is_pre_election: true
I20260808 07:02:07.622831 1789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca48ddaed38f4d478cb040fe35f92603" candidate_uuid: "dda5755633244ecaab8a679067c6f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bf24d29b1cc4b668807b38102a1d264" is_pre_election: true
I20260808 07:02:07.622896 2188 raft_consensus.cc:2454] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda5755633244ecaab8a679067c6f947 in term 0.
I20260808 07:02:07.622959 1789 raft_consensus.cc:2454] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dda5755633244ecaab8a679067c6f947 in term 0.
I20260808 07:02:07.623126 1896 leader_election.cc:302] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4856b97a548a4159bd011d22f1132c5e, dda5755633244ecaab8a679067c6f947; no voters:
I20260808 07:02:07.623260 2309 raft_consensus.cc:2781] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:07.623325 2309 raft_consensus.cc:482] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:07.623342 2309 raft_consensus.cc:3037] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:07.624051 2309 raft_consensus.cc:504] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.624176 2309 leader_election.cc:288] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [CANDIDATE]: Term 1 election: Requested vote from peers 4bf24d29b1cc4b668807b38102a1d264 (127.26.23.129:45781), 4856b97a548a4159bd011d22f1132c5e (127.26.23.131:45479)
I20260808 07:02:07.624305 1789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca48ddaed38f4d478cb040fe35f92603" candidate_uuid: "dda5755633244ecaab8a679067c6f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bf24d29b1cc4b668807b38102a1d264"
I20260808 07:02:07.624316 2188 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca48ddaed38f4d478cb040fe35f92603" candidate_uuid: "dda5755633244ecaab8a679067c6f947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4856b97a548a4159bd011d22f1132c5e"
I20260808 07:02:07.624382 1789 raft_consensus.cc:3037] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:07.624396 2188 raft_consensus.cc:3037] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:07.625062 1789 raft_consensus.cc:2454] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda5755633244ecaab8a679067c6f947 in term 1.
I20260808 07:02:07.625139 2188 raft_consensus.cc:2454] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dda5755633244ecaab8a679067c6f947 in term 1.
I20260808 07:02:07.625234 1894 leader_election.cc:302] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bf24d29b1cc4b668807b38102a1d264, dda5755633244ecaab8a679067c6f947; no voters:
I20260808 07:02:07.625334 2309 raft_consensus.cc:2781] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:07.625473 2309 raft_consensus.cc:686] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 1 LEADER]: Becoming Leader. State: Replica: dda5755633244ecaab8a679067c6f947, State: Running, Role: LEADER
I20260808 07:02:07.625600 2309 consensus_queue.cc:237] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } }
I20260808 07:02:07.626376 1578 catalog_manager.cc:5495] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 reported cstate change: term changed from 0 to 1, leader changed from <none> to dda5755633244ecaab8a679067c6f947 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "dda5755633244ecaab8a679067c6f947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dda5755633244ecaab8a679067c6f947" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39411 } health_report { overall_health: HEALTHY } } }
I20260808 07:02:07.644285 2299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.643273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53204 (local address 127.26.23.130:39411)
0808 07:02:07.643331 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.643333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.643342 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:07.643430 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.643430 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.643445 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.643494 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.644068 (+ 574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.644069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.644070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.644074 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.644091 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.644095 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.644144 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.644196 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.644207 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:07.645947 2188 raft_consensus.cc:1261] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 1 FOLLOWER]: Refusing update from remote peer dda5755633244ecaab8a679067c6f947: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:07.645948 1789 raft_consensus.cc:1261] T ca48ddaed38f4d478cb040fe35f92603 P 4bf24d29b1cc4b668807b38102a1d264 [term 1 FOLLOWER]: Refusing update from remote peer dda5755633244ecaab8a679067c6f947: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:07.646311 2313 consensus_queue.cc:1035] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4856b97a548a4159bd011d22f1132c5e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:07.646421 2309 consensus_queue.cc:1035] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bf24d29b1cc4b668807b38102a1d264" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:07.649245 2317 mvcc.cc:205] Tried to move back new op lower bound from 7316162673235165184 to 7316162673154961408. Current Snapshot: MvccSnapshot[applied={T|T < 7316162673235165184}]
I20260808 07:02:07.650849 1579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:07.650949 1579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:07.651667 1579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 249455718bfd4b0190033837ec787e90: Sending DeleteTablet for 3 replicas of tablet ca48ddaed38f4d478cb040fe35f92603
I20260808 07:02:07.651996 1760 tablet_service.cc:1514] Processing DeleteTablet for tablet ca48ddaed38f4d478cb040fe35f92603 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:07 UTC) from {username='slave'} at 127.0.0.1:37276
I20260808 07:02:07.652082 1954 tablet_service.cc:1514] Processing DeleteTablet for tablet ca48ddaed38f4d478cb040fe35f92603 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:07 UTC) from {username='slave'} at 127.0.0.1:53194
I20260808 07:02:07.652091 2155 tablet_service.cc:1514] Processing DeleteTablet for tablet ca48ddaed38f4d478cb040fe35f92603 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:07 UTC) from {username='slave'} at 127.0.0.1:58416
I20260808 07:02:07.652340 2339 tablet_replica.cc:330] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: stopping tablet replica
I20260808 07:02:07.652442 2339 raft_consensus.cc:2229] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:07.652519 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 1662
I20260808 07:02:07.652544 2339 raft_consensus.cc:2258] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:07.656286 2339 ts_tablet_manager.cc:1905] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:07.657941 2339 ts_tablet_manager.cc:1918] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:07.658013 2339 log.cc:1196] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/ca48ddaed38f4d478cb040fe35f92603
I20260808 07:02:07.658310 2339 ts_tablet_manager.cc:1939] T ca48ddaed38f4d478cb040fe35f92603 P 4856b97a548a4159bd011d22f1132c5e: Deleting consensus metadata
I20260808 07:02:07.658690 1558 catalog_manager.cc:4841] TS 4856b97a548a4159bd011d22f1132c5e (127.26.23.131:45479): tablet ca48ddaed38f4d478cb040fe35f92603 (table test-table [id=17172d52101945f98335570e11c28668]) successfully deleted
I20260808 07:02:07.666314 2338 tablet_replica.cc:330] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: stopping tablet replica
I20260808 07:02:07.666448 2338 raft_consensus.cc:2229] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:07.666596 2338 raft_consensus.cc:2258] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 07:02:07.666769 1556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:45781 (error 108)
I20260808 07:02:07.667136 2338 ts_tablet_manager.cc:1905] T ca48ddaed38f4d478cb040fe35f92603 P dda5755633244ecaab8a679067c6f947: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:07.667205 2291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.667081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:45781 (local address 127.0.0.1:37284)
0808 07:02:07.667130 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.667169 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:45781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:02:07.667312 1556 catalog_manager.cc:4584] TS 4bf24d29b1cc4b668807b38102a1d264 (127.26.23.129:45781): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca48ddaed38f4d478cb040fe35f92603: Network error: Client connection negotiation failed: client connection to 127.26.23.129:45781: connect: Connection refused (error 111)
I20260808 07:02:07.667621 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 1873
I20260808 07:02:07.675238 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 2057
I20260808 07:02:07.675287 2291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.675182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:39411 (local address 127.0.0.1:53210)
0808 07:02:07.675227 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.675254 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.130:39411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 07:02:07.684818 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 1532
2026-08-08T07:02:07Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (707 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 07:02:07.707347 26718 mini_oidc.cc:152] Starting JWKS server
I20260808 07:02:07.708427 26718 webserver.cc:460] Webserver started at https://127.0.0.1:41575/ using document root <none> and password file <none>
I20260808 07:02:07.708519 26718 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:02:07.708693 26718 webserver.cc:460] Webserver started at http://127.0.0.1:33611/ using document root <none> and password file <none>
2026-08-08T07:02:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:07Z Disabled control of system clock
I20260808 07:02:07.716671 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:38619
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:46177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:38619
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41575/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/testchainca.cert with env {}
W20260808 07:02:07.796465 2352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:07.796674 2352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:07.796696 2352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:07.797866 2352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:07.797905 2352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:07.797916 2352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:07.797927 2352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:07.797941 2352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:02:07.797964 2352 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:02:07.797979 2352 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41575/jwks.json
I20260808 07:02:07.799543 2352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:38619
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:38619
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41575/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:07.799782 2352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:07.799984 2352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:07.804641 2360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.804664 2363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:07.804656 2366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:07.804908 2352 server_base.cc:1034] running on GCE node
I20260808 07:02:07.805154 2352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:07.805405 2352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:07.806536 2352 hybrid_clock.cc:648] HybridClock initialized: now 1786172527806519 us; error 34 us; skew 500 ppm
I20260808 07:02:07.807659 2352 webserver.cc:460] Webserver started at http://127.26.23.190:34127/ using document root <none> and password file <none>
I20260808 07:02:07.807858 2352 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:07.807904 2352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:07.808029 2352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:07.809036 2352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "feb5b4317c9dc75983d3e9813249795c"
server_key_iv: "059a45dc6b3d4b6398cecbe46388a5ab"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.809376 2352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "feb5b4317c9dc75983d3e9813249795c"
server_key_iv: "059a45dc6b3d4b6398cecbe46388a5ab"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.810647 2352 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:07.811335 2376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:07.811491 2352 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:07.811591 2352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e"
format_stamp: "Formatted at 2026-08-08 07:02:07 on dist-test-slave-zj8q"
server_key: "feb5b4317c9dc75983d3e9813249795c"
server_key_iv: "059a45dc6b3d4b6398cecbe46388a5ab"
server_key_version: "encryptionkey@0"
I20260808 07:02:07.811666 2352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:07.819926 2352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:07.820168 2352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:07.820262 2352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:07.823973 2352 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:38619
I20260808 07:02:07.824004 2457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:38619 every 8 connection(s)
I20260808 07:02:07.824308 2352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:07.825232 2459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:07.827520 2459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e: Bootstrap starting.
I20260808 07:02:07.828078 2459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:07.828347 2459 log.cc:824] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:07.829034 2459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e: No bootstrap required, opened a new log
I20260808 07:02:07.830627 2459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38619 } }
I20260808 07:02:07.830770 2459 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:07.830804 2459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa800b7499e4cefaeaaa4c2a8fa3e2e, State: Initialized, Role: FOLLOWER
I20260808 07:02:07.830818 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 2352
I20260808 07:02:07.830920 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:07.830947 2459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38619 } }
I20260808 07:02:07.831032 2459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:07.831072 2459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:07.831101 26718 external_mini_cluster.cc:1428] Setting key d49f9e1b56b7ed73a9f9c3ab18635376
I20260808 07:02:07.831128 2459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:07.831787 2459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38619 } }
I20260808 07:02:07.831897 2459 leader_election.cc:302] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fa800b7499e4cefaeaaa4c2a8fa3e2e; no voters:
I20260808 07:02:07.832050 2459 leader_election.cc:288] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:07.832093 2469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:07.832194 2469 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [term 1 LEADER]: Becoming Leader. State: Replica: 7fa800b7499e4cefaeaaa4c2a8fa3e2e, State: Running, Role: LEADER
I20260808 07:02:07.832285 2469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38619 } }
I20260808 07:02:07.832319 2459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:07.832677 2472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38619 } } }
I20260808 07:02:07.832770 2472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:07.832751 2474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fa800b7499e4cefaeaaa4c2a8fa3e2e. Latest consensus state: current_term: 1 leader_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fa800b7499e4cefaeaaa4c2a8fa3e2e" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38619 } } }
I20260808 07:02:07.832840 2474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:07.833019 2488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:07.833531 2488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:07.835104 2488 catalog_manager.cc:1347] Generated new cluster ID: 59200371892749ec88319366206e40de
I20260808 07:02:07.835160 2488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:07.836745 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.831572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55580 (local address 127.26.23.190:38619)
0808 07:02:07.831794 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.831803 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.831831 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:02:07.831943 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.831951 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.832018 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.832446 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:07.832555 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:07.833968 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:07.834888 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:07.835406 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:07.835520 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:07.836140 (+ 620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:07.836144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:07.836144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:07.836318 (+ 174us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:07.836352 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:07.836362 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:07.836417 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:07.836490 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 07:02:07.836570 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":94,"threads_started":1}
I20260808 07:02:07.837697 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:02:07.842378 2488 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:07.842900 2488 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:07.851379 2488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fa800b7499e4cefaeaaa4c2a8fa3e2e: Generated new TSK 0
I20260808 07:02:07.851529 2488 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 07:02:07.882015 2516 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 07:02:07.882237 2516 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 07:02:07.882256 2465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:07.859575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55586 (local address 127.26.23.190:38619)
0808 07:02:07.859632 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:07.859634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:07.859698 (+ 64us) server_negotiation.cc:407] Connection header received
0808 07:02:07.859786 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:07.859787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:07.859797 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:07.859851 (+ 54us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:02:07.859996 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:07.860491 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:07.861614 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:07.861810 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:07.861862 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:07.862073 (+ 211us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:02:07.881990 (+ 19917us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 07:02:07.882187 (+ 197us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55586: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 07:02:07.882319 2465 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55586: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 07:02:07.882654 2515 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:07.859428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:38619 (local address 127.0.0.1:55586)
0808 07:02:07.859617 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:07.859636 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:07.859708 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:07.859866 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:07.859867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:07.859869 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:02:07.859936 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:07.859939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:07.860562 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:07.860563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:07.861528 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:07.861531 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:07.861888 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:07.861889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:07.861955 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:07.861977 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:02:07.882139 (+ 20162us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 07:02:07.882279 (+ 140us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.23.190:38619: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":94,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.26.23.190:38619: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41575/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 07:02:07.883114 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 2352
2026-08-08T07:02:07Z chronyd exiting
I20260808 07:02:07.929675 26718 test_util.cc:175] -----------------------------------------------
I20260808 07:02:07.929759 26718 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786172503363962-26718-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (223 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 07:02:07.930550 26718 mini_oidc.cc:152] Starting JWKS server
I20260808 07:02:07.931216 26718 webserver.cc:460] Webserver started at https://127.0.0.1:46013/ using document root <none> and password file <none>
I20260808 07:02:07.931257 26718 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:02:07.931362 26718 webserver.cc:460] Webserver started at http://127.0.0.1:39541/ using document root <none> and password file <none>
2026-08-08T07:02:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:07Z Disabled control of system clock
I20260808 07:02:07.939461 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:32919
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:44813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:32919
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46013/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/testchainca.cert with env {}
W20260808 07:02:08.019754 2523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:08.019974 2523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:08.019996 2523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:08.021440 2523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:08.021494 2523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:08.021512 2523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:08.021529 2523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:08.021545 2523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:02:08.021570 2523 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:02:08.021592 2523 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46013/jwks.json
I20260808 07:02:08.023240 2523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:44813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:32919
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:32919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46013/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:08.023433 2523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:08.023597 2523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:08.028070 2533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:08.028097 2536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:08.028239 2523 server_base.cc:1034] running on GCE node
W20260808 07:02:08.028370 2532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:08.028597 2523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:08.028874 2523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:08.030016 2523 hybrid_clock.cc:648] HybridClock initialized: now 1786172528030007 us; error 26 us; skew 500 ppm
I20260808 07:02:08.031248 2523 webserver.cc:460] Webserver started at http://127.26.23.190:43795/ using document root <none> and password file <none>
I20260808 07:02:08.031457 2523 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:08.031507 2523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:08.031636 2523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:08.032682 2523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "851615ac0b3b49d6a201eae8ec3381da"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "b99ad9798a5adf4ab5026931503beefc"
server_key_iv: "af8d82609f9a7ded8db0f66c65222b2f"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.033010 2523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "851615ac0b3b49d6a201eae8ec3381da"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "b99ad9798a5adf4ab5026931503beefc"
server_key_iv: "af8d82609f9a7ded8db0f66c65222b2f"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.034291 2523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:02:08.034978 2548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:08.035130 2523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:08.035215 2523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "851615ac0b3b49d6a201eae8ec3381da"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "b99ad9798a5adf4ab5026931503beefc"
server_key_iv: "af8d82609f9a7ded8db0f66c65222b2f"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.035281 2523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:08.046121 2523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:08.046453 2523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:08.046581 2523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:08.050405 2523 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:32919
I20260808 07:02:08.050441 2627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:32919 every 8 connection(s)
I20260808 07:02:08.050752 2523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:08.051386 2628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:08.053273 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 2523
I20260808 07:02:08.053366 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:08.053530 26718 external_mini_cluster.cc:1428] Setting key 93b0f353a070f5609f28431b7a11c4d6
I20260808 07:02:08.054605 2628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da: Bootstrap starting.
I20260808 07:02:08.055343 2628 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:08.055675 2628 log.cc:824] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:08.056388 2628 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da: No bootstrap required, opened a new log
I20260808 07:02:08.058528 2628 raft_consensus.cc:348] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851615ac0b3b49d6a201eae8ec3381da" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 32919 } }
I20260808 07:02:08.058666 2628 raft_consensus.cc:374] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:08.058699 2628 raft_consensus.cc:729] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 851615ac0b3b49d6a201eae8ec3381da, State: Initialized, Role: FOLLOWER
I20260808 07:02:08.058827 2628 consensus_queue.cc:260] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851615ac0b3b49d6a201eae8ec3381da" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 32919 } }
I20260808 07:02:08.058890 2628 raft_consensus.cc:388] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:08.058911 2628 raft_consensus.cc:482] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:08.058955 2628 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:08.059413 2634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:08.054072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42224 (local address 127.26.23.190:32919)
0808 07:02:08.054292 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:08.054301 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:08.054333 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:02:08.054889 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:08.054899 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:08.054986 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:08.055141 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:08.055300 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.056670 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.057406 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.058028 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.058189 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.058770 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:08.058775 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:08.058775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:08.058967 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:08.059011 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:08.059025 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:08.059078 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:08.059173 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 07:02:08.059254 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260808 07:02:08.059554 2628 raft_consensus.cc:504] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851615ac0b3b49d6a201eae8ec3381da" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 32919 } }
I20260808 07:02:08.059664 2628 leader_election.cc:302] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 851615ac0b3b49d6a201eae8ec3381da; no voters:
I20260808 07:02:08.059813 2628 leader_election.cc:288] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:08.059844 2636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:08.059978 2636 raft_consensus.cc:686] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [term 1 LEADER]: Becoming Leader. State: Replica: 851615ac0b3b49d6a201eae8ec3381da, State: Running, Role: LEADER
I20260808 07:02:08.060051 2628 sys_catalog.cc:564] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:08.060200 2636 consensus_queue.cc:237] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851615ac0b3b49d6a201eae8ec3381da" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 32919 } }
I20260808 07:02:08.060411 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:02:08.060555 2645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 851615ac0b3b49d6a201eae8ec3381da. Latest consensus state: current_term: 1 leader_uuid: "851615ac0b3b49d6a201eae8ec3381da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851615ac0b3b49d6a201eae8ec3381da" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 32919 } } }
I20260808 07:02:08.060642 2645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:08.060576 2643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "851615ac0b3b49d6a201eae8ec3381da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "851615ac0b3b49d6a201eae8ec3381da" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 32919 } } }
I20260808 07:02:08.060798 2643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da [sys.catalog]: This master's current role is: LEADER
W20260808 07:02:08.061842 2665 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:02:08.061926 2665 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:02:08.062119 2652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:08.062294 2652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:08.063726 2652 catalog_manager.cc:1347] Generated new cluster ID: 40e6b65063854ae69417e36cbcf22cff
I20260808 07:02:08.063771 2652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:08.078761 2652 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:08.079237 2652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:08.085487 2652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 851615ac0b3b49d6a201eae8ec3381da: Generated new TSK 0
I20260808 07:02:08.085707 2652 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 07:02:08.108749 2681 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 07:02:08.108915 2681 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 07:02:08.109095 2634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:08.095156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42230 (local address 127.26.23.190:32919)
0808 07:02:08.095215 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:08.095217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:08.095315 (+ 98us) server_negotiation.cc:407] Connection header received
0808 07:02:08.095389 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:08.095389 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:08.095402 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:08.095465 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:02:08.095587 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.096087 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.096834 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.097037 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.097088 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.097258 (+ 170us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:02:08.108885 (+ 11627us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46013/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 07:02:08.109022 (+ 137us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42230: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46013/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 07:02:08.109155 2634 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42230: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46013/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 07:02:08.109329 2680 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:08.095107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:32919 (local address 127.0.0.1:42230)
0808 07:02:08.095254 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:08.095263 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:08.095322 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:08.095468 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:08.095469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:08.095470 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:02:08.095531 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:08.095533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.096165 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.096167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:08.096762 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:08.096764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.097095 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.097096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:08.097165 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.097171 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:02:08.109126 (+ 11955us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46013/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 07:02:08.109245 (+ 119us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.23.190:32919: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46013/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260808 07:02:08.109623 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 2523
2026-08-08T07:02:08Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (225 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 07:02:08.156440 26718 mini_oidc.cc:152] Starting JWKS server
I20260808 07:02:08.157110 26718 webserver.cc:460] Webserver started at https://127.0.0.1:37645/ using document root <none> and password file <none>
I20260808 07:02:08.157162 26718 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 07:02:08.157298 26718 webserver.cc:460] Webserver started at http://127.0.0.1:38435/ using document root <none> and password file <none>
2026-08-08T07:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:08Z Disabled control of system clock
I20260808 07:02:08.165176 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40665
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:40739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:40665
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37645/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 07:02:08.244004 2690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:08.244202 2690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:08.244231 2690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:08.245661 2690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:08.245721 2690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:08.245740 2690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:08.245755 2690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:08.245770 2690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:02:08.245788 2690 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:02:08.245810 2690 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37645/jwks.json
I20260808 07:02:08.247362 2690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:40665
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37645/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:08.247609 2690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:08.247879 2690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:08.252529 2706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:08.252529 2701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:08.252516 2703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:08.252758 2690 server_base.cc:1034] running on GCE node
I20260808 07:02:08.252980 2690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:08.253232 2690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:08.254360 2690 hybrid_clock.cc:648] HybridClock initialized: now 1786172528254342 us; error 32 us; skew 500 ppm
I20260808 07:02:08.255473 2690 webserver.cc:460] Webserver started at http://127.26.23.190:33255/ using document root <none> and password file <none>
I20260808 07:02:08.255705 2690 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:08.255751 2690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:08.255882 2690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:08.256924 2690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "3a5d2ac4d60541adb4b47d198d99ce00"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "3184fc2f8afc5dac289ab07a72016b2f"
server_key_iv: "37fc0c772d27944a3d411d6122b1aca0"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.257248 2690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "3a5d2ac4d60541adb4b47d198d99ce00"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "3184fc2f8afc5dac289ab07a72016b2f"
server_key_iv: "37fc0c772d27944a3d411d6122b1aca0"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.258493 2690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:08.259156 2715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:08.259292 2690 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:08.259370 2690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "3a5d2ac4d60541adb4b47d198d99ce00"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "3184fc2f8afc5dac289ab07a72016b2f"
server_key_iv: "37fc0c772d27944a3d411d6122b1aca0"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.259435 2690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:08.287027 2690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:08.287333 2690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:08.287459 2690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:08.291302 2690 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:40665
I20260808 07:02:08.291344 2792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:40665 every 8 connection(s)
I20260808 07:02:08.291664 2690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:08.292299 2793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:08.294931 2793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00: Bootstrap starting.
I20260808 07:02:08.295482 2793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:08.295756 2793 log.cc:824] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:08.296391 2793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00: No bootstrap required, opened a new log
I20260808 07:02:08.297964 2793 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40665 } }
I20260808 07:02:08.298101 2793 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:08.298139 2793 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5d2ac4d60541adb4b47d198d99ce00, State: Initialized, Role: FOLLOWER
I20260808 07:02:08.298297 2793 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40665 } }
I20260808 07:02:08.298358 2793 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:08.298389 2793 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:08.298436 2793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:08.298942 2793 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40665 } }
I20260808 07:02:08.299031 2793 leader_election.cc:302] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a5d2ac4d60541adb4b47d198d99ce00; no voters:
I20260808 07:02:08.299196 2793 leader_election.cc:288] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:08.299234 2797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:08.299295 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 2690
I20260808 07:02:08.299347 2797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [term 1 LEADER]: Becoming Leader. State: Replica: 3a5d2ac4d60541adb4b47d198d99ce00, State: Running, Role: LEADER
I20260808 07:02:08.299405 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:08.299441 2793 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:08.299590 26718 external_mini_cluster.cc:1428] Setting key 1baed605a0d6778602b09a50582b4105
I20260808 07:02:08.299435 2797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40665 } }
I20260808 07:02:08.300518 2799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a5d2ac4d60541adb4b47d198d99ce00. Latest consensus state: current_term: 1 leader_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40665 } } }
I20260808 07:02:08.300594 2799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:08.300670 2798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5d2ac4d60541adb4b47d198d99ce00" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40665 } } }
I20260808 07:02:08.300745 2798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:08.300839 2815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:08.301369 2815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:08.303202 2815 catalog_manager.cc:1347] Generated new cluster ID: 617452a499b3474abbc2498267a70c44
I20260808 07:02:08.303256 2815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:08.305610 2807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:08.300043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45676 (local address 127.26.23.190:40665)
0808 07:02:08.300225 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:08.300234 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:08.300352 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:02:08.301143 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:08.301157 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:08.301239 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:08.301384 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:08.301596 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.302932 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.303771 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.304196 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.304302 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.304926 (+ 624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:08.304930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:08.304931 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:08.305096 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:08.305138 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:08.305148 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:08.305202 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:08.305277 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:02:08.305438 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":78,"threads_started":1}
I20260808 07:02:08.306406 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:02:08.314574 2815 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:08.315212 2815 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:08.319732 2815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a5d2ac4d60541adb4b47d198d99ce00: Generated new TSK 0
I20260808 07:02:08.319890 2815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:02:08.331662 2807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:08.328573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45692 (local address 127.26.23.190:40665)
0808 07:02:08.328621 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:08.328623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:08.328693 (+ 70us) server_negotiation.cc:407] Connection header received
0808 07:02:08.328762 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:08.328763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:08.328774 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:08.328831 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:02:08.328950 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.329462 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.330226 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.330430 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.330484 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.330643 (+ 159us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:02:08.331469 (+ 826us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 07:02:08.331598 (+ 129us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45692: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:02:08.331712 2807 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45692: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 07:02:08.331789 2835 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:08.328495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40665 (local address 127.0.0.1:45692)
0808 07:02:08.328637 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:08.328647 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:08.328707 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:08.328834 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:08.328835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:08.328836 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:02:08.328895 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:08.328898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.329536 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.329537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:08.330125 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:08.330128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.330496 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.330498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:08.330557 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.330562 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:02:08.331566 (+ 1004us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 07:02:08.331686 (+ 120us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.23.190:40665: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37645/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260808 07:02:08.332293 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 2690
E20260808 07:02:08.349022 2836 webserver.cc:533] Webserver: sslize failed:
E20260808 07:02:08.349105 2836 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T07:02:08Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (220 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T07:02:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:08Z Disabled control of system clock
I20260808 07:02:08.385283 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:35899
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:41383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:35899
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/testchainca.cert with env {}
W20260808 07:02:08.464457 2844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:08.464653 2844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:08.464674 2844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:08.465835 2844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:08.465878 2844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:08.465889 2844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:08.465900 2844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:08.465914 2844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 07:02:08.465938 2844 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 07:02:08.465958 2844 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 07:02:08.467455 2844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:41383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:35899
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:35899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:08.467684 2844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:08.467880 2844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:08.472422 2857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:08.472411 2855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:08.472452 2854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:08.472568 2844 server_base.cc:1034] running on GCE node
I20260808 07:02:08.472919 2844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:08.473196 2844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:08.474330 2844 hybrid_clock.cc:648] HybridClock initialized: now 1786172528474312 us; error 31 us; skew 500 ppm
I20260808 07:02:08.475436 2844 webserver.cc:460] Webserver started at http://127.26.23.190:35285/ using document root <none> and password file <none>
I20260808 07:02:08.475658 2844 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:08.475708 2844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:08.475829 2844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:08.476845 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "07293d5ff51a43248edb2c89b9d524ac"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "eb46dca6a0a0debef7fe69a8684a9c9f"
server_key_iv: "68f51cf5025ed6ec32ba095d7dd8f107"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.477177 2844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "07293d5ff51a43248edb2c89b9d524ac"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "eb46dca6a0a0debef7fe69a8684a9c9f"
server_key_iv: "68f51cf5025ed6ec32ba095d7dd8f107"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.478390 2844 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:02:08.479077 2868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:08.479233 2844 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:08.479317 2844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "07293d5ff51a43248edb2c89b9d524ac"
format_stamp: "Formatted at 2026-08-08 07:02:08 on dist-test-slave-zj8q"
server_key: "eb46dca6a0a0debef7fe69a8684a9c9f"
server_key_iv: "68f51cf5025ed6ec32ba095d7dd8f107"
server_key_version: "encryptionkey@0"
I20260808 07:02:08.479382 2844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:08.497377 2844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:08.497676 2844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:08.497808 2844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:08.501633 2844 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:35899
I20260808 07:02:08.501677 2947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:35899 every 8 connection(s)
I20260808 07:02:08.501977 2844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:08.502933 2948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:08.505107 2948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac: Bootstrap starting.
I20260808 07:02:08.505650 2948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:08.505889 2948 log.cc:824] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:08.506524 2948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac: No bootstrap required, opened a new log
I20260808 07:02:08.508049 2948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07293d5ff51a43248edb2c89b9d524ac" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35899 } }
I20260808 07:02:08.508193 2948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:08.508215 2948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07293d5ff51a43248edb2c89b9d524ac, State: Initialized, Role: FOLLOWER
I20260808 07:02:08.508311 2948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07293d5ff51a43248edb2c89b9d524ac" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35899 } }
I20260808 07:02:08.508358 2948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:08.508383 2948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:08.508412 2948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:08.508867 2948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07293d5ff51a43248edb2c89b9d524ac" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35899 } }
I20260808 07:02:08.508950 2948 leader_election.cc:302] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07293d5ff51a43248edb2c89b9d524ac; no voters:
I20260808 07:02:08.509073 2948 leader_election.cc:288] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:08.509123 2955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:08.509284 2955 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [term 1 LEADER]: Becoming Leader. State: Replica: 07293d5ff51a43248edb2c89b9d524ac, State: Running, Role: LEADER
I20260808 07:02:08.509295 2948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:08.509392 2955 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07293d5ff51a43248edb2c89b9d524ac" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35899 } }
I20260808 07:02:08.509395 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 2844
I20260808 07:02:08.509502 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:08.509651 26718 external_mini_cluster.cc:1428] Setting key c16cf68c8a8af494ddd443824260b6b5
I20260808 07:02:08.510094 2958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07293d5ff51a43248edb2c89b9d524ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07293d5ff51a43248edb2c89b9d524ac" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35899 } } }
I20260808 07:02:08.510233 2958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:08.510226 2960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07293d5ff51a43248edb2c89b9d524ac. Latest consensus state: current_term: 1 leader_uuid: "07293d5ff51a43248edb2c89b9d524ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07293d5ff51a43248edb2c89b9d524ac" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 35899 } } }
I20260808 07:02:08.510349 2960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac [sys.catalog]: This master's current role is: LEADER
W20260808 07:02:08.511266 2981 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:02:08.511322 2981 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:02:08.511379 2972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:08.511543 2972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:08.513012 2972 catalog_manager.cc:1347] Generated new cluster ID: bf39d46946854eb18de5a8bbc78ec1fa
I20260808 07:02:08.513067 2972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:08.515281 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:08.510284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58208 (local address 127.26.23.190:35899)
0808 07:02:08.510966 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:08.510975 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:08.511008 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:02:08.511100 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:08.511106 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:08.511165 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:08.511279 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:08.511517 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.512665 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.513476 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.513896 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.514003 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.514649 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:08.514653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:08.514653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:08.514813 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:08.514845 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:08.514855 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:08.514910 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:08.514987 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:02:08.515066 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":103,"threads_started":1}
I20260808 07:02:08.518931 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:02:08.524293 2972 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:08.524909 2972 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:08.529433 2972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07293d5ff51a43248edb2c89b9d524ac: Generated new TSK 0
I20260808 07:02:08.529585 2972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:02:08.549566 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:08.541644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58218 (local address 127.26.23.190:35899)
0808 07:02:08.541688 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:08.541690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:08.541786 (+ 96us) server_negotiation.cc:407] Connection header received
0808 07:02:08.541865 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:08.541865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:08.541875 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:08.541922 (+ 47us) server_negotiation.cc:226] Negotiated authn=JWT
0808 07:02:08.542051 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.542654 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.543774 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.543974 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.544021 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.544182 (+ 161us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 07:02:08.549386 (+ 5204us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 07:02:08.549507 (+ 121us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58218: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:02:08.549620 2971 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58218: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 07:02:08.549703 2996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:08.541561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:35899 (local address 127.0.0.1:58218)
0808 07:02:08.541721 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:08.541732 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:08.541797 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:08.541932 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:08.541932 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:08.541934 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 07:02:08.541994 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:08.541996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.542726 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.542727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:08.543696 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:08.543699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:08.544039 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:08.544040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:08.544100 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:08.544105 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 07:02:08.549482 (+ 5377us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 07:02:08.549594 (+ 112us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.26.23.190:35899: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260808 07:02:08.550015 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 2844
2026-08-08T07:02:08Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (198 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (89 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:08 dist-test-slave-zj8q krb5kdc[3022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:08 dist-test-slave-zj8q krb5kdc[3022](info): set up 2 sockets
Aug 08 07:02:08 dist-test-slave-zj8q krb5kdc[3022](info): commencing operation
krb5kdc: starting...
W20260808 07:02:09.866492 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:09 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:09.982750 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:41301
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:41301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:10.064604 3043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:10.064800 3043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:10.064829 3043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:10.065971 3043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:10.066012 3043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:10.066032 3043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:10.066047 3043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:10.066063 3043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:10.067509 3043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:41301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:41301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:10.067749 3043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:10.067941 3043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:10.072651 3054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:10.072724 3053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:10.072984 3058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:10.072993 3043 server_base.cc:1034] running on GCE node
I20260808 07:02:10.073280 3043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:10.073566 3043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:10.074700 3043 hybrid_clock.cc:648] HybridClock initialized: now 1786172530074685 us; error 32 us; skew 500 ppm
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.077078 3043 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:10.077452 3043 webserver.cc:460] Webserver started at http://127.26.23.190:38151/ using document root <none> and password file <none>
I20260808 07:02:10.077644 3043 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:10.077683 3043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:10.077771 3043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:10.078797 3043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "1562a6b3e1494a3784ba0aed81c3b1e2"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "4eea92456969a08cc42d9cee9e6f92cb"
server_key_iv: "7990a9a28ab6543f481036aaa8de0465"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.079087 3043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "1562a6b3e1494a3784ba0aed81c3b1e2"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "4eea92456969a08cc42d9cee9e6f92cb"
server_key_iv: "7990a9a28ab6543f481036aaa8de0465"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.080264 3043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:10.080907 3066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.081081 3043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:10.081178 3043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "1562a6b3e1494a3784ba0aed81c3b1e2"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "4eea92456969a08cc42d9cee9e6f92cb"
server_key_iv: "7990a9a28ab6543f481036aaa8de0465"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.081252 3043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:10.100971 3043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:10.102797 3043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:10.102910 3043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:10.106674 3043 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:41301
I20260808 07:02:10.106711 3157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:41301 every 8 connection(s)
I20260808 07:02:10.107020 3043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:10.107851 3158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:10.110077 3158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2: Bootstrap starting.
I20260808 07:02:10.110658 3158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:10.110929 3158 log.cc:824] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:10.111539 3158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2: No bootstrap required, opened a new log
I20260808 07:02:10.113139 3158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41301 } }
I20260808 07:02:10.113274 3158 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:10.113296 3158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1562a6b3e1494a3784ba0aed81c3b1e2, State: Initialized, Role: FOLLOWER
I20260808 07:02:10.113430 3158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41301 } }
I20260808 07:02:10.113507 3158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:10.113543 3158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:10.113592 3158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:10.114076 3158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41301 } }
I20260808 07:02:10.114197 3158 leader_election.cc:302] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1562a6b3e1494a3784ba0aed81c3b1e2; no voters:
I20260808 07:02:10.114347 3158 leader_election.cc:288] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:10.114393 3161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:10.114586 3158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:10.114743 3161 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [term 1 LEADER]: Becoming Leader. State: Replica: 1562a6b3e1494a3784ba0aed81c3b1e2, State: Running, Role: LEADER
I20260808 07:02:10.114836 3161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41301 } }
I20260808 07:02:10.115260 3162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41301 } } }
I20260808 07:02:10.115362 3162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:10.115541 3163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1562a6b3e1494a3784ba0aed81c3b1e2. Latest consensus state: current_term: 1 leader_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1562a6b3e1494a3784ba0aed81c3b1e2" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 41301 } } }
I20260808 07:02:10.115607 3163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:10.115648 3178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:10.116166 3178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:10.117172 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 3043
I20260808 07:02:10.117281 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:10.117484 26718 external_mini_cluster.cc:1428] Setting key 64c0b86f43438aa6ee07b6c4b445b8e1
I20260808 07:02:10.117718 3178 catalog_manager.cc:1347] Generated new cluster ID: a0aad328f87543abbc5d9c86eab61fd0
I20260808 07:02:10.117767 3178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172529, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:10.127879 3178 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:10.128499 3178 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:10.128824 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.118091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34418 (local address 127.26.23.190:41301)
0808 07:02:10.118264 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.118273 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.118307 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:02:10.118423 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.118430 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.118483 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.118624 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.119291 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.120720 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.121691 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.122358 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.122468 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.125071 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.125075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.125075 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.125086 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.126979 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.127378 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.127381 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.127383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.127488 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.127725 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.127726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.127727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.127989 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.128125 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.128276 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.128578 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260808 07:02:10.132732 3178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1562a6b3e1494a3784ba0aed81c3b1e2: Generated new TSK 0
I20260808 07:02:10.132889 3178 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:02:10.163363 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41301
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:10.244383 3207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:10.244585 3207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:10.244616 3207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:10.245740 3207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:10.245776 3207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:10.245800 3207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:10.247251 3207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:10.247437 3207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:10.247658 3207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:10.252430 3221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:10.252480 3207 server_base.cc:1034] running on GCE node
W20260808 07:02:10.252449 3219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:10.252449 3218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:10.252818 3207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:10.253021 3207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:10.254186 3207 hybrid_clock.cc:648] HybridClock initialized: now 1786172530254178 us; error 35 us; skew 500 ppm
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.256711 3207 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:02:10.257107 3207 webserver.cc:460] Webserver started at http://127.26.23.129:45957/ using document root <none> and password file <none>
I20260808 07:02:10.257277 3207 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:10.257313 3207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:10.257407 3207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:10.258432 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "4a75eeec1740429d8f4b3cbb3863c49b"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "e8f6e95cd7e3c1f4b15dd373326b5c8c"
server_key_iv: "c252c7208883f7266f4c6c8ea929071b"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.258734 3207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "4a75eeec1740429d8f4b3cbb3863c49b"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "e8f6e95cd7e3c1f4b15dd373326b5c8c"
server_key_iv: "c252c7208883f7266f4c6c8ea929071b"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.259889 3207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:10.260505 3229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.260667 3207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:10.260752 3207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "4a75eeec1740429d8f4b3cbb3863c49b"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "e8f6e95cd7e3c1f4b15dd373326b5c8c"
server_key_iv: "c252c7208883f7266f4c6c8ea929071b"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.260812 3207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:10.269943 3207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:10.271598 3207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:10.271730 3207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:10.271919 3207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:10.272187 3207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:10.272220 3207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.272246 3207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:10.272270 3207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.277887 3207 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:37789
I20260808 07:02:10.277940 3408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:37789 every 8 connection(s)
I20260808 07:02:10.278298 3207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:10.287005 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.278946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:49461 (local address 127.26.23.190:41301)
0808 07:02:10.278989 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.278991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.279190 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:02:10.280116 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.280117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.280132 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.280180 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.280789 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.281293 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.282299 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.282508 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.282561 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.284488 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.284490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.284490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.284499 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.285679 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.286066 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.286067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.286068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.286121 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.286391 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.286392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.286392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.286502 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.286559 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.286823 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.286913 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:02:10.287151 3412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.278920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41301 (local address 127.26.23.129:49461)
0808 07:02:10.279067 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:10.279102 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:10.280006 (+ 904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:10.280259 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:10.280263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:10.280513 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:10.280698 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:10.280702 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.281373 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.281374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:10.282214 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:10.282217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.282576 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.282577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:10.282717 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.283124 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:10.283133 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:10.284404 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:10.285752 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:10.285759 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:10.285761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:10.286002 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:10.286229 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:10.286230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:10.286230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:10.286335 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:10.286559 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:10.286565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:10.286703 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 07:02:10.286788 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:02:10.286938 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260808 07:02:10.287616 3410 heartbeater.cc:347] Connected to a master server at 127.26.23.190:41301
I20260808 07:02:10.287706 3410 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:10.287870 3410 heartbeater.cc:511] Master 127.26.23.190:41301 requested a full tablet report, sending...
I20260808 07:02:10.288153 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 3207
I20260808 07:02:10.288272 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:10.288434 3091 ts_manager.cc:194] Registered new tserver with Master: 4a75eeec1740429d8f4b3cbb3863c49b (127.26.23.129:37789)
I20260808 07:02:10.288468 26718 external_mini_cluster.cc:1428] Setting key c2dcc376fdc9ebde9b77f959184176a6
I20260808 07:02:10.289106 3091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:49461
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:02:10.313126 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41301
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:10.395138 3417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:10.395330 3417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:10.395352 3417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:10.396493 3417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:10.396533 3417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:10.396556 3417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:10.397990 3417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:10.398224 3417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:10.398434 3417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:10.403069 3428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:10.403075 3431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:10.403303 3417 server_base.cc:1034] running on GCE node
W20260808 07:02:10.403079 3427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:10.403555 3417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:10.403769 3417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:10.404903 3417 hybrid_clock.cc:648] HybridClock initialized: now 1786172530404885 us; error 33 us; skew 500 ppm
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.407408 3417 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:02:10.407812 3417 webserver.cc:460] Webserver started at http://127.26.23.130:36359/ using document root <none> and password file <none>
I20260808 07:02:10.407979 3417 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:10.408015 3417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:10.408105 3417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:10.409051 3417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "cd691aae04704a94925b7a12d6c39b5e"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "da44671ba2909c3c816618c05433e916"
server_key_iv: "af7aad2fedd33b632c9de256427fd17e"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.409351 3417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "cd691aae04704a94925b7a12d6c39b5e"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "da44671ba2909c3c816618c05433e916"
server_key_iv: "af7aad2fedd33b632c9de256427fd17e"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.410549 3417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:02:10.411170 3439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.411293 3417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.411373 3417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "cd691aae04704a94925b7a12d6c39b5e"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "da44671ba2909c3c816618c05433e916"
server_key_iv: "af7aad2fedd33b632c9de256427fd17e"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.411439 3417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:10.421046 3417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:10.423092 3417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:10.423225 3417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:10.423425 3417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:10.423686 3417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:10.423719 3417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.423740 3417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:10.423763 3417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.429229 3417 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:46367
I20260808 07:02:10.429284 3631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:46367 every 8 connection(s)
I20260808 07:02:10.429550 3417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:10.437875 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 3417
I20260808 07:02:10.437983 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:10.438239 26718 external_mini_cluster.cc:1428] Setting key f06e4d3188bab616ab4c32ea7e19c33c
I20260808 07:02:10.438266 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.430212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:48827 (local address 127.26.23.190:41301)
0808 07:02:10.430270 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.430272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.430455 (+ 183us) server_negotiation.cc:407] Connection header received
0808 07:02:10.431395 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.431397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.431410 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.431463 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.432065 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.432559 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.433508 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.433719 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.433775 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.435762 (+ 1987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.435764 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.435765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.435771 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.436964 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.437328 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.437328 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.437329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.437390 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.437600 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.437600 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.437601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.437698 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.437742 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.438077 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.438182 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:10.438443 3634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.430180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41301 (local address 127.26.23.130:48827)
0808 07:02:10.430348 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:10.430383 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:10.431291 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:10.431528 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:10.431532 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:10.431777 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:10.431974 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:10.431979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.432645 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.432646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:10.433425 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:10.433428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.433789 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.433790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:10.433910 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.434350 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:10.434358 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:10.435671 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:10.437042 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:10.437049 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:10.437051 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:10.437269 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:10.437446 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:10.437447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:10.437447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:10.437555 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:10.437748 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:10.437753 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:10.437914 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 07:02:10.438036 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 07:02:10.438224 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260808 07:02:10.438863 3632 heartbeater.cc:347] Connected to a master server at 127.26.23.190:41301
I20260808 07:02:10.438964 3632 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:10.439160 3632 heartbeater.cc:511] Master 127.26.23.190:41301 requested a full tablet report, sending...
I20260808 07:02:10.439543 3091 ts_manager.cc:194] Registered new tserver with Master: cd691aae04704a94925b7a12d6c39b5e (127.26.23.130:46367)
I20260808 07:02:10.439889 3091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:48827
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:02:10.462961 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41301
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:10.543306 3640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:10.543509 3640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:10.543540 3640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:10.544672 3640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:10.544714 3640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:10.544749 3640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:10.546247 3640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:41301
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:10.546468 3640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:10.546679 3640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:10.551337 3652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:10.551493 3649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:10.551344 3647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:10.551599 3640 server_base.cc:1034] running on GCE node
I20260808 07:02:10.551812 3640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:10.552034 3640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:10.553165 3640 hybrid_clock.cc:648] HybridClock initialized: now 1786172530553157 us; error 27 us; skew 500 ppm
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.555584 3640 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:02:10.556020 3640 webserver.cc:460] Webserver started at http://127.26.23.131:40591/ using document root <none> and password file <none>
I20260808 07:02:10.556217 3640 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:10.556264 3640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:10.556387 3640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:10.557413 3640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "2a06c15af8bc46049c5b33fb42fc2097"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "036025cfd12c852bad26a59aad84c6b1"
server_key_iv: "980451da1dec9aa2a1c55b0230bd8884"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.557744 3640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "2a06c15af8bc46049c5b33fb42fc2097"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "036025cfd12c852bad26a59aad84c6b1"
server_key_iv: "980451da1dec9aa2a1c55b0230bd8884"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.559027 3640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:10.559669 3660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.559803 3640 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:10.559890 3640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "2a06c15af8bc46049c5b33fb42fc2097"
format_stamp: "Formatted at 2026-08-08 07:02:10 on dist-test-slave-zj8q"
server_key: "036025cfd12c852bad26a59aad84c6b1"
server_key_iv: "980451da1dec9aa2a1c55b0230bd8884"
server_key_version: "encryptionkey@0"
I20260808 07:02:10.559947 3640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:10.604792 3640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:10.606740 3640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:10.606880 3640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:10.607122 3640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:10.607434 3640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:10.607468 3640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.607499 3640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:10.607523 3640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:10.613154 3640 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:44183
I20260808 07:02:10.613229 3827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:44183 every 8 connection(s)
I20260808 07:02:10.613518 3640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:10.618187 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 3640
I20260808 07:02:10.618301 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:10.618491 26718 external_mini_cluster.cc:1428] Setting key 294a0fe5fb06af01870c8fb087aeec9b
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:10.622850 3203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.614276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:42115 (local address 127.26.23.190:41301)
0808 07:02:10.614318 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.614320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.614523 (+ 203us) server_negotiation.cc:407] Connection header received
0808 07:02:10.615677 (+ 1154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.615679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.615695 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.615742 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.616441 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.616958 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.617951 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.618178 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.618244 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.620506 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.620508 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.620508 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.620516 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.621579 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.621951 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.621952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.621952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.622007 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.622255 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.622256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.622257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.622369 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.622423 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.622680 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.622760 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:02:10.623018 3831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.614258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:41301 (local address 127.26.23.131:42115)
0808 07:02:10.614402 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:10.614438 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:10.615563 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:10.615823 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:10.615827 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:10.616143 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:10.616346 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:10.616352 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.617041 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.617042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:10.617865 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:10.617868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.618254 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.618256 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:10.618404 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.618894 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:10.618904 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:10.620422 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:10.621668 (+ 1246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:10.621675 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:10.621678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:10.621888 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:10.622059 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:10.622060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:10.622060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:10.622196 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:10.622423 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:10.622430 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:10.622561 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 07:02:10.622651 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:02:10.622805 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260808 07:02:10.623440 3828 heartbeater.cc:347] Connected to a master server at 127.26.23.190:41301
I20260808 07:02:10.623536 3828 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:10.623682 3828 heartbeater.cc:511] Master 127.26.23.190:41301 requested a full tablet report, sending...
I20260808 07:02:10.623989 3091 ts_manager.cc:194] Registered new tserver with Master: 2a06c15af8bc46049c5b33fb42fc2097 (127.26.23.131:44183)
I20260808 07:02:10.624323 3091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:42115
I20260808 07:02:10.630110 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/test-admin.keytab.
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.645975 26718 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 07:02:10.647604 3841 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:10.646904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43128 (local address 127.26.23.129:37789)
0808 07:02:10.647099 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.647104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.647115 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:10.647143 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.647145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.647158 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.647221 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.647537 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43128: BlockingRecv error: recv got EOF from 127.0.0.1:43128 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
W20260808 07:02:10.647831 26718 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc)
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.648738 26718 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.649595 26718 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:02:10.656417 3841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.650096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43140 (local address 127.26.23.129:37789)
0808 07:02:10.650136 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.650138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.650211 (+ 73us) server_negotiation.cc:407] Connection header received
0808 07:02:10.650265 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.650266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.650275 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.650308 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.650668 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.651382 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.652057 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.652362 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.652410 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.654302 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.654310 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.654310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.654316 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.655524 (+ 1208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.655822 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.655825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.655825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.655877 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.656006 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.656007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.656007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.656121 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.656209 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.656261 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.656319 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 07:02:10.657990 3841 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:10.657539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43146 (local address 127.26.23.129:37789)
0808 07:02:10.657586 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.657587 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.657643 (+ 56us) server_negotiation.cc:407] Connection header received
0808 07:02:10.657685 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.657685 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.657694 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.657735 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.657946 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43146: BlockingRecv error: recv got EOF from 127.0.0.1:43146 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 07:02:10.658074 26718 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc)
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.658962 26718 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.659698 26718 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:02:10.665577 3841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.660120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43162 (local address 127.26.23.129:37789)
0808 07:02:10.660169 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.660170 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.660189 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:02:10.660232 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.660233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.660241 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.660272 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.660553 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.660995 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.661577 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.661754 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.661796 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.663609 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.663611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.663611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.663616 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.664668 (+ 1052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.664983 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.664984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.664985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.665041 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.665185 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.665185 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.665185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.665267 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.665331 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.665408 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.665469 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 07:02:10.666822 3841 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:10.666418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43178 (local address 127.26.23.129:37789)
0808 07:02:10.666470 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.666471 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.666484 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:02:10.666535 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.666536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.666543 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.666579 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.666780 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43178: BlockingRecv error: recv got EOF from 127.0.0.1:43178 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 07:02:10.666894 26718 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786172503363962-26718-0/krb5kdc/krb5cc)
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.667740 26718 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:10.668483 26718 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:02:10.674424 3841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:10.668908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43186 (local address 127.26.23.129:37789)
0808 07:02:10.668942 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:10.668944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:10.668967 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:02:10.669012 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:10.669013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:10.669019 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:10.669058 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:10.669380 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.669861 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.670598 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:10.670780 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:10.670833 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:10.672611 (+ 1778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:10.672612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:10.672612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:10.672617 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:10.673655 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.673917 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.673918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.673918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.673961 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:10.674079 (+ 118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:10.674079 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:10.674079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:10.674171 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:10.674240 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:10.674318 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:02:10.674372 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:02:10.674978 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 3207
I20260808 07:02:10.685057 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 3417
I20260808 07:02:10.690979 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 3640
I20260808 07:02:10.710846 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 3043
2026-08-08T07:02:10Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1984 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3864](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3864](info): set up 2 sockets
Aug 08 07:02:10 dist-test-slave-zj8q krb5kdc[3864](info): commencing operation
krb5kdc: starting...
W20260808 07:02:11.856511 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:11 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:11Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab.
Entry for principal oryx/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab.
I20260808 07:02:11.968786 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39323
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab
--principal=oryx/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39323
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:12.051502 3885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:12.051713 3885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:12.051743 3885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:12.052884 3885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:12.052928 3885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:12.052947 3885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:12.052963 3885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:12.052979 3885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:12.054474 3885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab
--principal=oryx/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:12.054713 3885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:12.054916 3885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:12.059571 3893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.059579 3894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.059579 3896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.059809 3885 server_base.cc:1034] running on GCE node
I20260808 07:02:12.060097 3885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:12.060359 3885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:12.061529 3885 hybrid_clock.cc:648] HybridClock initialized: now 1786172532061507 us; error 31 us; skew 500 ppm
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:12.066752 3885 init.cc:377] Logged in from keytab as oryx/127.26.23.190@KRBTEST.COM (short username oryx)
I20260808 07:02:12.067236 3885 webserver.cc:460] Webserver started at http://127.26.23.190:39665/ using document root <none> and password file <none>
I20260808 07:02:12.067428 3885 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.067476 3885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.067606 3885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:12.068674 3885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "677b77c85e974c5994f5637502175827"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "b83d095ff4f685a9c4799aca660a3051"
server_key_iv: "cd6c39532be8c876a624110d5a39a873"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.069010 3885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "677b77c85e974c5994f5637502175827"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "b83d095ff4f685a9c4799aca660a3051"
server_key_iv: "cd6c39532be8c876a624110d5a39a873"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.070247 3885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 07:02:12.070923 3907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.071065 3885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:12.071161 3885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "677b77c85e974c5994f5637502175827"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "b83d095ff4f685a9c4799aca660a3051"
server_key_iv: "cd6c39532be8c876a624110d5a39a873"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.071223 3885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.084124 3885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:12.085917 3885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:12.086051 3885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:12.090019 3885 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39323
I20260808 07:02:12.090056 3997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39323 every 8 connection(s)
I20260808 07:02:12.090425 3885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:12.091370 3998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:12.093035 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 3885
I20260808 07:02:12.093137 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:12.093313 26718 external_mini_cluster.cc:1428] Setting key 92172375dedcaf83ee53b0e04c201a7b
I20260808 07:02:12.093763 3998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Bootstrap starting.
I20260808 07:02:12.094410 3998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:12.094722 3998 log.cc:824] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:12.095477 3998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: No bootstrap required, opened a new log
I20260808 07:02:12.097517 3998 raft_consensus.cc:348] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } }
I20260808 07:02:12.097666 3998 raft_consensus.cc:374] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:12.097687 3998 raft_consensus.cc:729] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 677b77c85e974c5994f5637502175827, State: Initialized, Role: FOLLOWER
I20260808 07:02:12.097800 3998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } }
I20260808 07:02:12.097884 3998 raft_consensus.cc:388] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:12.097918 3998 raft_consensus.cc:482] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:12.097965 3998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:12.098539 3998 raft_consensus.cc:504] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } }
I20260808 07:02:12.098632 3998 leader_election.cc:302] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 677b77c85e974c5994f5637502175827; no voters:
I20260808 07:02:12.098789 3998 leader_election.cc:288] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:12.098824 4003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:12.098934 4003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 LEADER]: Becoming Leader. State: Replica: 677b77c85e974c5994f5637502175827, State: Running, Role: LEADER
I20260808 07:02:12.099015 4003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } }
I20260808 07:02:12.099045 3998 sys_catalog.cc:564] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:12.099547 4009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 677b77c85e974c5994f5637502175827. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } }
I20260808 07:02:12.099638 4009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:12.100555 4005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } }
I20260808 07:02:12.100628 4005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
W20260808 07:02:12.101235 4029 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:02:12.101292 4029 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:02:12.101349 4016 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:12.101522 4016 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:12.102857 4016 catalog_manager.cc:1347] Generated new cluster ID: 7e1423a21eee408db0b85254b6cfcd64
I20260808 07:02:12.102905 4016 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:12.104674 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.093804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60636 (local address 127.26.23.190:39323)
0808 07:02:12.093950 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.093957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.093982 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:02:12.094455 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.094463 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.094516 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.094642 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.095356 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.096272 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.097312 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.097752 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.097851 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.100549 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.100554 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.100554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.100566 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.103330 (+ 2764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.103645 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.103649 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.103649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.103740 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.103909 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.103909 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.103910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.104139 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.104280 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.104374 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.104503 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":69,"threads_started":1}
I20260808 07:02:12.110984 4016 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:12.111479 4016 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:12.120714 4016 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Generated new TSK 0
I20260808 07:02:12.120863 4016 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab.
Entry for principal oryx/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab.
I20260808 07:02:12.152722 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39323
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:12.269579 4035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:12.269793 4035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:12.269815 4035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:12.270920 4035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:12.270954 4035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:12.270979 4035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:12.272374 4035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:12.272560 4035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:12.272742 4035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:12.277576 4048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.277606 4045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.277586 4050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.278187 4035 server_base.cc:1034] running on GCE node
I20260808 07:02:12.278395 4035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:12.278623 4035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:12.279780 4035 hybrid_clock.cc:648] HybridClock initialized: now 1786172532279762 us; error 29 us; skew 500 ppm
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:12.282336 4035 init.cc:377] Logged in from keytab as oryx/127.26.23.129@KRBTEST.COM (short username oryx)
I20260808 07:02:12.282788 4035 webserver.cc:460] Webserver started at http://127.26.23.129:44067/ using document root <none> and password file <none>
I20260808 07:02:12.283001 4035 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.283049 4035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.283175 4035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:12.284185 4035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "e4388ab480a77665239b2d6662ec85ca"
server_key_iv: "28f42e0b9408054b0a77e95f22a82d7c"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.284528 4035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "e4388ab480a77665239b2d6662ec85ca"
server_key_iv: "28f42e0b9408054b0a77e95f22a82d7c"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.285758 4035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:12.286487 4061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.286628 4035 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.286715 4035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "e4388ab480a77665239b2d6662ec85ca"
server_key_iv: "28f42e0b9408054b0a77e95f22a82d7c"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.286782 4035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.300510 4035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:12.302313 4035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:12.302449 4035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:12.302660 4035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:12.302964 4035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:12.303006 4035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.303036 4035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:12.303054 4035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.308588 4035 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:44227
I20260808 07:02:12.308638 4249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:44227 every 8 connection(s)
I20260808 07:02:12.308924 4035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:12.317567 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.309579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:42185 (local address 127.26.23.190:39323)
0808 07:02:12.309624 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.309626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.309853 (+ 227us) server_negotiation.cc:407] Connection header received
0808 07:02:12.310432 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.310433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.310445 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.310504 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.311442 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.311954 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.312931 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.313139 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.313194 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.315225 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.315227 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.315227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.315234 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.316449 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.316853 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.316854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.316854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.316899 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.317071 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.317072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.317072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.317178 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.317224 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.317423 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.317493 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:12.317780 4253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.309550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:42185)
0808 07:02:12.309736 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.309771 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.310331 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.310583 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.310587 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.311156 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.311346 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.311351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.312036 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.312037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.312848 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.312851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.313209 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.313209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.313331 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.313755 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.313763 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.315140 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.316527 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.316534 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.316536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.316796 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.316943 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.316943 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.316943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.317031 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.317221 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.317223 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.317330 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.317405 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.317521 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":105,"threads_started":1}
I20260808 07:02:12.318307 4250 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39323
I20260808 07:02:12.318341 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 4035
I20260808 07:02:12.318399 4250 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:12.318413 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:12.318569 4250 heartbeater.cc:511] Master 127.26.23.190:39323 requested a full tablet report, sending...
I20260808 07:02:12.318593 26718 external_mini_cluster.cc:1428] Setting key ce12a09eaa8d5c4f09b1074c48c6afe0
I20260808 07:02:12.319125 3937 ts_manager.cc:194] Registered new tserver with Master: b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227)
I20260808 07:02:12.319722 3937 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:42185
WARNING: no policy specified for oryx/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab.
Entry for principal oryx/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab.
I20260808 07:02:12.342387 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39323
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:12.424374 4257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:12.424572 4257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:12.424603 4257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:12.425726 4257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:12.425765 4257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:12.425798 4257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:12.427245 4257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:12.427477 4257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:12.427675 4257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:02:12.432545 4257 server_base.cc:1034] running on GCE node
W20260808 07:02:12.432523 4272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.432550 4268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.432562 4269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.433007 4257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:12.433223 4257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:12.434361 4257 hybrid_clock.cc:648] HybridClock initialized: now 1786172532434349 us; error 28 us; skew 500 ppm
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:12.436791 4257 init.cc:377] Logged in from keytab as oryx/127.26.23.130@KRBTEST.COM (short username oryx)
I20260808 07:02:12.437292 4257 webserver.cc:460] Webserver started at http://127.26.23.130:43769/ using document root <none> and password file <none>
I20260808 07:02:12.437527 4257 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.437579 4257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.437709 4257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:12.438773 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "aee349deaffd4bda83e8a2e44c385793"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "c306e4dccc5ebc599efc0d288d557c65"
server_key_iv: "fa1bd9e91c603af48f546768b4212ac8"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.439093 4257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "aee349deaffd4bda83e8a2e44c385793"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "c306e4dccc5ebc599efc0d288d557c65"
server_key_iv: "fa1bd9e91c603af48f546768b4212ac8"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.440311 4257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:12.441071 4281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.441252 4257 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:12.441334 4257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "aee349deaffd4bda83e8a2e44c385793"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "c306e4dccc5ebc599efc0d288d557c65"
server_key_iv: "fa1bd9e91c603af48f546768b4212ac8"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.441403 4257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.466837 4257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:12.468909 4257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:12.469028 4257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:12.469274 4257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:12.469585 4257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:12.469619 4257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.469659 4257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:12.469682 4257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.475337 4257 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:45935
I20260808 07:02:12.475390 4463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:45935 every 8 connection(s)
I20260808 07:02:12.475698 4257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:12.477074 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 4257
I20260808 07:02:12.477180 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:12.477394 26718 external_mini_cluster.cc:1428] Setting key e92ccef6e6749673b4d62702a77f564f
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:12.485272 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.476346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:43651 (local address 127.26.23.190:39323)
0808 07:02:12.476422 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.476424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.476620 (+ 196us) server_negotiation.cc:407] Connection header received
0808 07:02:12.477133 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.477134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.477147 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.477214 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.478409 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.478902 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.480230 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.480424 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.480479 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.482517 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.482519 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.482519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.482528 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.483997 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.484395 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.484396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.484396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.484463 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.484669 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.484669 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.484670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.484803 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.484875 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.485095 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.485176 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:02:12.485337 4468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.476335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:43651)
0808 07:02:12.476502 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.476540 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.477033 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.477363 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.477368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.478039 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.478324 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.478332 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.478991 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.478992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.480152 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.480155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.480491 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.480492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.480623 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.481071 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.481080 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.482420 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.484090 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.484097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.484099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.484325 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.484523 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.484524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.484524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.484616 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.484863 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.484867 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.484979 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.485056 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.485174 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260808 07:02:12.485786 4464 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39323
I20260808 07:02:12.485874 4464 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:12.486039 4464 heartbeater.cc:511] Master 127.26.23.190:39323 requested a full tablet report, sending...
I20260808 07:02:12.486434 3937 ts_manager.cc:194] Registered new tserver with Master: aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935)
WARNING: no policy specified for oryx/127.26.23.131@KRBTEST.COM; defaulting to no policy
I20260808 07:02:12.486884 3937 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:43651
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab.
Entry for principal oryx/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab.
I20260808 07:02:12.503193 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39323
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:12.583096 4472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:12.583297 4472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:12.583318 4472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:12.584409 4472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:12.584445 4472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:12.584470 4472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:12.585866 4472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:12.586058 4472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:12.586282 4472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:12.591065 4481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.591118 4478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.591249 4472 server_base.cc:1034] running on GCE node
W20260808 07:02:12.591071 4479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.591516 4472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:12.591763 4472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:12.592901 4472 hybrid_clock.cc:648] HybridClock initialized: now 1786172532592885 us; error 29 us; skew 500 ppm
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:12.595259 4472 init.cc:377] Logged in from keytab as oryx/127.26.23.131@KRBTEST.COM (short username oryx)
I20260808 07:02:12.595695 4472 webserver.cc:460] Webserver started at http://127.26.23.131:33473/ using document root <none> and password file <none>
I20260808 07:02:12.595903 4472 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.595950 4472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.596071 4472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:12.597098 4472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "3a56aa865e064b658acca483187d8ffa"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "996a6e71cad75b90671f31569b3e0826"
server_key_iv: "08dfee0e0765432b1f5bb0793c9a89db"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.597458 4472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "3a56aa865e064b658acca483187d8ffa"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "996a6e71cad75b90671f31569b3e0826"
server_key_iv: "08dfee0e0765432b1f5bb0793c9a89db"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.598757 4472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:12.599435 4492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.599613 4472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:12.599728 4472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "3a56aa865e064b658acca483187d8ffa"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "996a6e71cad75b90671f31569b3e0826"
server_key_iv: "08dfee0e0765432b1f5bb0793c9a89db"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.599803 4472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.607105 4472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:12.608685 4472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:12.608788 4472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:12.608942 4472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:12.609165 4472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:12.609193 4472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.609212 4472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:12.609228 4472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.614815 4472 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:33641
I20260808 07:02:12.614869 4659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:33641 every 8 connection(s)
I20260808 07:02:12.615134 4472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:12.617725 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 4472
I20260808 07:02:12.617798 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:12.617934 26718 external_mini_cluster.cc:1428] Setting key b340445be0fd71ba4d351b7cb114220c
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:12.623683 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.615724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:54315 (local address 127.26.23.190:39323)
0808 07:02:12.615784 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.615786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.615972 (+ 186us) server_negotiation.cc:407] Connection header received
0808 07:02:12.616431 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.616432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.616442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.616477 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.617466 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.618096 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.619204 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.619411 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.619467 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.621440 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.621442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.621442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.621449 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.622706 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.623028 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.623029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.623030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.623074 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.623245 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.623245 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.623246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.623338 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.623381 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.623565 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.623618 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:02:12.623847 4667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.615706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:54315)
0808 07:02:12.615869 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.615901 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.616344 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.616534 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.616538 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.617184 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.617376 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.617382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.618254 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.618255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.619124 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.619128 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.619479 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.619480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.619596 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.619994 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.620002 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.621361 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.622766 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.622772 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.622774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.622975 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.623119 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.623120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.623120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.623204 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.623378 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.623380 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.623481 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.623548 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.623660 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260808 07:02:12.624287 4660 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39323
I20260808 07:02:12.624366 4660 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:12.624517 4660 heartbeater.cc:511] Master 127.26.23.190:39323 requested a full tablet report, sending...
I20260808 07:02:12.624848 3937 ts_manager.cc:194] Registered new tserver with Master: 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:12.625198 3937 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:54315
I20260808 07:02:12.629474 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.23.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.189.keytab.
Entry for principal oryx/127.26.23.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.189.keytab.
I20260808 07:02:12.652469 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:38633
--webserver_interface=127.26.23.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.189.keytab
--principal=oryx/127.26.23.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39323,127.26.23.189:38633
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:12.732698 4670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:12.732895 4670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:12.732924 4670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:12.734028 4670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:12.734068 4670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:12.734088 4670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:12.734103 4670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:12.734119 4670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:12.735590 4670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39323,127.26.23.189:38633
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.189.keytab
--principal=oryx/127.26.23.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:38633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.23.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
W20260808 07:02:12.735713 4670 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.26.23.190:39323,127.26.23.189:38633'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 07:02:12.735867 4670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:12.736071 4670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:12.740696 4678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.740702 4677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.740805 4670 server_base.cc:1034] running on GCE node
W20260808 07:02:12.740696 4681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.741159 4670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:12.741403 4670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:12.742542 4670 hybrid_clock.cc:648] HybridClock initialized: now 1786172532742528 us; error 29 us; skew 500 ppm
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:12.745015 4670 init.cc:377] Logged in from keytab as oryx/127.26.23.189@KRBTEST.COM (short username oryx)
I20260808 07:02:12.745455 4670 webserver.cc:460] Webserver started at http://127.26.23.189:42347/ using document root <none> and password file <none>
I20260808 07:02:12.745693 4670 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.745745 4670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.745869 4670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:12.746918 4670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/instance:
uuid: "b0fe266cb41646bda51be988439109f5"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "9de8ef345388a8b7a3f010ebb2698cef"
server_key_iv: "2b1be9ec088967b8d1acde4f1b91bcf2"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.747246 4670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal/instance:
uuid: "b0fe266cb41646bda51be988439109f5"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "9de8ef345388a8b7a3f010ebb2698cef"
server_key_iv: "2b1be9ec088967b8d1acde4f1b91bcf2"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.748447 4670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:12.749117 4694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.749267 4670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:12.749351 4670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
uuid: "b0fe266cb41646bda51be988439109f5"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "9de8ef345388a8b7a3f010ebb2698cef"
server_key_iv: "2b1be9ec088967b8d1acde4f1b91bcf2"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.749411 4670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.760380 4670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:12.761979 4670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:12.762104 4670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:12.765781 4670 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.189:38633
I20260808 07:02:12.765820 4772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.189:38633 every 8 connection(s)
I20260808 07:02:12.766119 4670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
I20260808 07:02:12.766772 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 4670
I20260808 07:02:12.767247 4773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:12.769500 4773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.189@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:12.777202 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.770235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33330 (local address 127.26.23.190:39323)
0808 07:02:12.770291 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.770293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.770418 (+ 125us) server_negotiation.cc:407] Connection header received
0808 07:02:12.770478 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.770479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.770491 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.770536 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.770963 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.771441 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.772198 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.772385 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.772438 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.774758 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.774760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.774760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.774768 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.776013 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.776377 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.776379 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.776379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.776441 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.776597 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.776598 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.776598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.776792 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.776857 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.777033 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.777110 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:12.777345 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.767442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48382 (local address 127.26.23.189:38633)
0808 07:02:12.767616 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.767626 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.767659 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:02:12.768177 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.768187 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.768249 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.768400 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.769014 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.770307 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.771044 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.771468 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.771570 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.774055 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.774061 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.774061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.774067 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.775783 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.776120 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.776122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.776122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.776198 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.776394 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.776395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.776395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.776661 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.776809 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.776878 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.776987 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260808 07:02:12.777349 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.770133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33330)
0808 07:02:12.770313 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.770350 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.770417 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.770565 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.770569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.770819 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.770884 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.770885 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.771521 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.771522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.772120 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.772122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.772452 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.772453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.772523 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.772942 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.772951 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.774606 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.776083 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.776090 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.776092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.776301 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.776498 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.776498 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.776499 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.776548 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.776854 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.776861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.776910 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.776996 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.777099 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":112,"threads_started":1}
I20260808 07:02:12.777925 4773 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.189@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
I20260808 07:02:12.782946 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.778144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48396)
0808 07:02:12.778199 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.778209 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.778247 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.778340 (+ 93us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.778341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.778445 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.778473 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.778474 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.778996 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.778997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.779451 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.779452 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.779717 (+ 265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.779717 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.779764 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.780085 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.780090 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.781107 (+ 1017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.782249 (+ 1142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.782250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.782250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.782395 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.782532 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.782533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.782533 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.782573 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.782725 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.782726 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.782757 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.782800 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.782871 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 07:02:12.782999 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.778197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48396 (local address 127.26.23.189:38633)
0808 07:02:12.778226 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.778228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.778243 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:02:12.778285 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.778285 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.778292 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.778331 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.778511 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.778947 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.779501 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.779674 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.779715 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.781186 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.781187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.781187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.781193 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.782185 (+ 992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.782448 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.782449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.782449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.782492 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.782605 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.782606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.782606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.782688 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.782728 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.782816 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.782912 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":13}
I20260808 07:02:12.784195 4773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Bootstrap starting.
I20260808 07:02:12.784979 4773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:12.785238 4773 log.cc:824] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:12.785946 4773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: No bootstrap required, opened a new log
I20260808 07:02:12.787389 4773 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } }
I20260808 07:02:12.787509 4773 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:12.787530 4773 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fe266cb41646bda51be988439109f5, State: Initialized, Role: FOLLOWER
I20260808 07:02:12.787678 4773 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } }
I20260808 07:02:12.787994 4773 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:12.787963 4785 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } } }
I20260808 07:02:12.788039 4785 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:02:12.789538 4806 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:02:12.789594 4806 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:02:12.791146 4670 master_runner.cc:428] Detected that this master b0fe266cb41646bda51be988439109f5 is joining an existing cluster
I20260808 07:02:12.791211 4670 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.23.189:38633
I20260808 07:02:12.798105 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.792118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33344 (local address 127.26.23.190:39323)
0808 07:02:12.792159 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.792161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.792280 (+ 119us) server_negotiation.cc:407] Connection header received
0808 07:02:12.792359 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.792360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.792373 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.792435 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.792936 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.793681 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.794565 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.794840 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.794898 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.795695 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.795696 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.795696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.795703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.797016 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797407 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.797409 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.797409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.797464 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797639 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.797640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.797641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.797762 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.797818 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.797945 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.798010 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:02:12.798131 4814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.792081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33344)
0808 07:02:12.792219 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.792229 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.792303 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.792485 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.792487 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.792760 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.792849 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.792851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.793759 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.793760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.794495 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.794497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.794896 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.794897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.794951 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.795278 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.795282 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.795628 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.797088 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.797090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.797328 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.797512 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797512 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.797512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.797566 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.797809 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.797810 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.797848 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.797906 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.798015 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":90,"threads_started":1}
I20260808 07:02:12.798275 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.792245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48406 (local address 127.26.23.189:38633)
0808 07:02:12.792282 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.792283 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.792424 (+ 141us) server_negotiation.cc:407] Connection header received
0808 07:02:12.792447 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.792448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.792456 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.792499 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.792898 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.793347 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.794260 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.794553 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.794621 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.795570 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.795572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.795572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.795579 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.797114 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797474 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.797475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.797475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.797533 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797734 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.797735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.797736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.797861 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.797921 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.798093 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.798193 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:12.798976 4816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.792133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48406)
0808 07:02:12.792373 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.792380 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.792414 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.792501 (+ 87us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.792502 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.792767 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.792834 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.792836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.793419 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.793420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.794128 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.794130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.794647 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.794647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.794706 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.795120 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.795124 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.795488 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.797208 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.797209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.797412 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.797616 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.797617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.797618 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.797675 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.797942 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.797943 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.797976 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.798583 (+ 607us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.798713 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":78,"threads_started":1}
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.190@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
I20260808 07:02:12.807219 4780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.800505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48418 (local address 127.26.23.189:38633)
0808 07:02:12.800541 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.800542 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.800634 (+ 92us) server_negotiation.cc:407] Connection header received
0808 07:02:12.800761 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.800761 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.800771 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.800815 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.801275 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.801704 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.802794 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.802965 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.803028 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.804954 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.804955 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.804956 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.804962 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.806172 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.806506 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.806507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.806507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.806558 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.806721 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.806722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.806722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.806819 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.806872 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.807055 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.807131 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:02:12.807228 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.800411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48418)
0808 07:02:12.800539 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.800584 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.800658 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.800823 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.800825 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.801157 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.801211 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.801214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.801806 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.801807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.802722 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.802726 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.803030 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.803031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.803114 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.803547 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.803552 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.804878 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.806246 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.806253 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.806255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.806443 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.806615 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.806616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.806616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.806672 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.806871 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.806879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.806931 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.807008 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.807131 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":70,"threads_started":1}
I20260808 07:02:12.808014 3937 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.23.189:38633: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b0fe266cb41646bda51be988439109f5"
member_type: NON_VOTER
last_known_addr {
host: "127.26.23.189"
port: 38633
}
attrs {
promote: true
}
}
dest_uuid: "677b77c85e974c5994f5637502175827"
cas_config_opid_index: -1
I20260808 07:02:12.808308 3937 consensus_queue.cc:237] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } }
I20260808 07:02:12.808766 4819 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER b0fe266cb41646bda51be988439109f5 (127.26.23.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } }
I20260808 07:02:12.809013 4737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:12.809803 4819 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.23.189:38633
I20260808 07:02:12.809861 4737 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Refusing update from remote peer 677b77c85e974c5994f5637502175827: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 07:02:12.810009 4670 master.cc:537] Master@127.26.23.189:38633 shutting down...
I20260808 07:02:12.810192 4819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } }
I20260808 07:02:12.810276 4819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:12.810238 4820 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 07:02:12.810961 3913 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 07:02:12.811511 3913 consensus_peers.cc:487] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 -> Peer b0fe266cb41646bda51be988439109f5 (127.26.23.189:38633): Couldn't send request to peer b0fe266cb41646bda51be988439109f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:02:12.812896 4670 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:12.812985 4670 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:12.813032 4670 tablet_replica.cc:330] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: stopping tablet replica
I20260808 07:02:12.825547 4670 master.cc:552] Master@127.26.23.189:38633 shutdown complete.
I20260808 07:02:12.825590 4670 master_runner.cc:305] Clearing existing system tablet
I20260808 07:02:12.825706 4670 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.825750 4670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.826315 4670 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:02:12.826743 4833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.826886 4670 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.826941 4670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.826963 4670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
uuid: "b0fe266cb41646bda51be988439109f5"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "9de8ef345388a8b7a3f010ebb2698cef"
server_key_iv: "2b1be9ec088967b8d1acde4f1b91bcf2"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.827610 4670 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:12.828922 4670 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 07:02:12.828979 4670 log.cc:1196] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 07:02:12.829150 4670 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Deleting consensus metadata
I20260808 07:02:12.829267 4670 master_runner.cc:315] Copying system tablet from 127.26.23.190:39323
I20260808 07:02:12.829818 4670 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: tablet copy: Beginning tablet copy session from remote peer at address 127.26.23.190:39323
I20260808 07:02:12.835382 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.830145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.26.23.190:39323)
0808 07:02:12.830251 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.830253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.830347 (+ 94us) server_negotiation.cc:407] Connection header received
0808 07:02:12.830409 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.830410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.830421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.830466 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.830756 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.831245 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.832036 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.832235 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.832286 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.833123 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.833124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.833124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.833132 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.834404 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.834702 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.834704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.834704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.834757 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.834915 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.834916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.834916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.835021 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.835077 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.835215 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.835287 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 07:02:12.835397 4840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.830051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33348)
0808 07:02:12.830276 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:12.830286 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:12.830352 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:12.830469 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:12.830470 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:12.830634 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:12.830690 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.830691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.831309 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.831311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.831956 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:12.831958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.832289 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.832290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:12.832354 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.832760 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:12.832765 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:12.833042 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:12.834482 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.834483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.834484 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.834644 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.834808 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:12.834809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:12.834809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:12.834866 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:12.835073 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:12.835074 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:12.835127 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:02:12.835185 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:02:12.835288 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":60,"threads_started":1}
I20260808 07:02:12.835759 3963 tablet_copy_service.cc:140] P 677b77c85e974c5994f5637502175827: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b0fe266cb41646bda51be988439109f5 ({username='oryx', principal='oryx/127.26.23.189@KRBTEST.COM'} at 127.0.0.1:33348)
I20260808 07:02:12.835867 3963 tablet_copy_service.cc:161] P 677b77c85e974c5994f5637502175827: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b0fe266cb41646bda51be988439109f5 at {username='oryx', principal='oryx/127.26.23.189@KRBTEST.COM'} at 127.0.0.1:33348: session id = b0fe266cb41646bda51be988439109f5-00000000000000000000000000000000
I20260808 07:02:12.836691 3963 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:02:12.837316 4670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 07:02:12.838295 4670 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: tablet copy: Starting download of 0 data blocks...
I20260808 07:02:12.838424 4670 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: tablet copy: Starting download of 1 WAL segments...
I20260808 07:02:12.839278 4670 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:02:12.840065 3963 tablet_copy_service.cc:342] P 677b77c85e974c5994f5637502175827: Request end of tablet copy session b0fe266cb41646bda51be988439109f5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.23.189@KRBTEST.COM'} at 127.0.0.1:33348
I20260808 07:02:12.840113 3963 tablet_copy_service.cc:433] P 677b77c85e974c5994f5637502175827: ending tablet copy session b0fe266cb41646bda51be988439109f5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b0fe266cb41646bda51be988439109f5
I20260808 07:02:12.842294 4670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:12.843314 4841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.843446 4846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:12.843597 4842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:12.843583 4670 server_base.cc:1034] running on GCE node
I20260808 07:02:12.843778 4670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:12.843911 4670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:12.845017 4670 hybrid_clock.cc:648] HybridClock initialized: now 1786172532845009 us; error 25 us; skew 500 ppm
Aug 08 07:02:12 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:12.846396 4670 init.cc:377] Logged in from keytab as oryx/127.26.23.189@KRBTEST.COM (short username oryx)
I20260808 07:02:12.846642 4670 webserver.cc:460] Webserver started at http://127.26.23.189:43855/ using document root <none> and password file <none>
I20260808 07:02:12.846750 4670 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:12.846782 4670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:12.847486 4670 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:12.848007 4857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:12.848130 4670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:12.848186 4670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
uuid: "b0fe266cb41646bda51be988439109f5"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "9de8ef345388a8b7a3f010ebb2698cef"
server_key_iv: "2b1be9ec088967b8d1acde4f1b91bcf2"
server_key_version: "encryptionkey@0"
I20260808 07:02:12.848237 4670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:12.862432 4670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:12.863907 4670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:12.867103 4670 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.189:38633
I20260808 07:02:12.867308 4940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.189:38633 every 8 connection(s)
I20260808 07:02:12.867496 4670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
I20260808 07:02:12.868206 4942 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:02:12.868590 4942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Bootstrap starting.
I20260808 07:02:12.870785 4942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:02:12.870977 4942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: Bootstrap complete.
I20260808 07:02:12.871150 4942 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } }
I20260808 07:02:12.871218 4942 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0fe266cb41646bda51be988439109f5, State: Initialized, Role: LEARNER
I20260808 07:02:12.871253 4942 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } }
I20260808 07:02:12.871420 4942 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:12.871404 4946 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } }
I20260808 07:02:12.871482 4946 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:02:12.872713 4965 catalog_manager.cc:1259] Loaded cluster ID: 7e1423a21eee408db0b85254b6cfcd64
I20260808 07:02:12.872758 4965 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: loading cluster ID for follower catalog manager: success
I20260808 07:02:12.873596 4965 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: acquiring CA information for follower catalog manager: success
I20260808 07:02:12.873904 4965 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:02:12.885289 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:12.878760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48446 (local address 127.26.23.189:38633)
0808 07:02:12.878880 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:12.878882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:12.878893 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:12.878916 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:12.878917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:12.878928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:12.879006 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:12.879495 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.880528 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.881201 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:12.881512 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:12.881592 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:12.882685 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:12.882687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:12.882687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:12.882694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:12.884177 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.884479 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.884480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.884480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.884544 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:12.884703 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:12.884703 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:12.884704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:12.884834 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:12.884932 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:12.885007 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:02:12.885087 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":52,"threads_started":1}
WARNING: no policy specified for oryx/127.26.23.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.188.keytab.
Entry for principal oryx/127.26.23.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.188.keytab.
I20260808 07:02:12.914925 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:34409
--webserver_interface=127.26.23.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.188.keytab
--principal=oryx/127.26.23.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:12.996589 4970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:12.996784 4970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:12.996804 4970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:12.997884 4970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:12.997920 4970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:12.997931 4970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:12.997942 4970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:12.997952 4970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:12.999490 4970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.188.keytab
--principal=oryx/127.26.23.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:34409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.23.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:12.999698 4970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:12.999869 4970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:02:13.004649 4970 server_base.cc:1034] running on GCE node
W20260808 07:02:13.004598 4980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.004624 4982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.004611 4978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.005084 4970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:13.005352 4970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:13.006484 4970 hybrid_clock.cc:648] HybridClock initialized: now 1786172533006466 us; error 34 us; skew 500 ppm
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:13.008790 4970 init.cc:377] Logged in from keytab as oryx/127.26.23.188@KRBTEST.COM (short username oryx)
I20260808 07:02:13.009177 4970 webserver.cc:460] Webserver started at http://127.26.23.188:36341/ using document root <none> and password file <none>
I20260808 07:02:13.009366 4970 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:13.009413 4970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:13.009536 4970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:13.010569 4970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/instance:
uuid: "363cd457a64d403a8cd880eb105a87d8"
format_stamp: "Formatted at 2026-08-08 07:02:13 on dist-test-slave-zj8q"
server_key: "a8d6d457822765a14c1456b8aa869c5f"
server_key_iv: "f60bcd9893f9500cfe27c343d0cc1c0f"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.010903 4970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal/instance:
uuid: "363cd457a64d403a8cd880eb105a87d8"
format_stamp: "Formatted at 2026-08-08 07:02:13 on dist-test-slave-zj8q"
server_key: "a8d6d457822765a14c1456b8aa869c5f"
server_key_iv: "f60bcd9893f9500cfe27c343d0cc1c0f"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.012154 4970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:13.012845 4998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.012989 4970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:13.013077 4970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
uuid: "363cd457a64d403a8cd880eb105a87d8"
format_stamp: "Formatted at 2026-08-08 07:02:13 on dist-test-slave-zj8q"
server_key: "a8d6d457822765a14c1456b8aa869c5f"
server_key_iv: "f60bcd9893f9500cfe27c343d0cc1c0f"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.013135 4970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:13.029809 4970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:13.031641 4970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:13.031777 4970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:13.035770 4970 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.188:34409
I20260808 07:02:13.035808 5086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.188:34409 every 8 connection(s)
I20260808 07:02:13.036142 4970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
I20260808 07:02:13.037057 5087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:13.038717 5087 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:02:13.040035 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 4970
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.188@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172531, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.23.188@KRBTEST.COM
I20260808 07:02:13.047906 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.039519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33362 (local address 127.26.23.190:39323)
0808 07:02:13.039584 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.039587 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.039664 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:02:13.040226 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.040227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.040237 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.040276 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.040943 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.041662 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.042878 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.043170 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.043239 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.045354 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.045355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.045356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.045363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.046640 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.047024 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.047026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.047026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.047081 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.047298 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.047299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.047299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.047406 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.047461 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.047724 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.047815 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:02:13.048098 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.039343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33362)
0808 07:02:13.039547 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.039591 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.040128 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.040357 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.040361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.040676 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.040870 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.040875 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.041744 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.041744 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.042817 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.042819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.043258 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.043258 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.043349 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.043824 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.043833 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.045274 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.046711 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.046718 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.046720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.046964 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.047135 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.047136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.047136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.047243 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.047460 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.047466 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.047595 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.047689 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.047830 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":88,"threads_started":1}
I20260808 07:02:13.048614 5087 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:02:13.048873 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.040535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45136 (local address 127.26.23.188:34409)
0808 07:02:13.040698 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.040701 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.040716 (+ 15us) server_negotiation.cc:407] Connection header received
0808 07:02:13.040733 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.040735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.040758 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.040819 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.041518 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.042710 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.043534 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.043900 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.043970 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.046139 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.046146 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.046147 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.046176 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.047486 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.047799 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.047801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.047802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.047851 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.048035 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.048036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.048036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.048206 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.048676 (+ 470us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.048721 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.048795 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":98,"threads_started":1}
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.188@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
I20260808 07:02:13.054091 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.048839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48450)
0808 07:02:13.048879 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.048888 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.048919 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.049158 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.049159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.049265 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.049315 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.049317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.049960 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.049961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.050470 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.050472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.050783 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.050783 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.050832 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.051158 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.051161 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.052179 (+ 1018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.053383 (+ 1204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.053384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.053384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.053526 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.053701 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.053701 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.053701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.053743 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.053902 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.053903 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.053934 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.053976 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.054034 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 07:02:13.054126 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.048922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.26.23.189:38633)
0808 07:02:13.048972 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.048974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.048981 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:13.049007 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.049008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.049020 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.049074 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.049426 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.049901 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.050525 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.050734 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.050782 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.052250 (+ 1468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.052251 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.052251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.052257 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.053321 (+ 1064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.053588 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.053589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.053590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.053654 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.053777 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.053778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.053778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.053865 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.053906 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.053993 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.054056 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:02:13.054492 5087 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.188@KRBTEST.COM for oryx/127.26.23.188@KRBTEST.COM
I20260808 07:02:13.059866 5089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.054694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45146)
0808 07:02:13.054729 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.054738 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.054772 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.054862 (+ 90us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.054863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.054976 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.054998 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.054999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.055558 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.055559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.056011 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.056012 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.056331 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.056332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.056377 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.056683 (+ 306us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.056688 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.057678 (+ 990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.059037 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.059037 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.059038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.059183 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.059336 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.059337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.059337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.059388 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.059578 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.059579 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.059622 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.059680 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.059768 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 07:02:13.059916 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.054749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45146 (local address 127.26.23.188:34409)
0808 07:02:13.054778 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.054779 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.054799 (+ 20us) server_negotiation.cc:407] Connection header received
0808 07:02:13.054814 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.054815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.054823 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.054862 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.055054 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.055496 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.056073 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.056278 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.056328 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.057748 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.057749 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.057749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.057755 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.058967 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.059239 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.059240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.059240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.059287 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.059435 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.059435 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.059436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.059529 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.059580 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.059705 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.059816 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":15}
I20260808 07:02:13.061127 5087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Bootstrap starting.
I20260808 07:02:13.061862 5087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:13.062085 5087 log.cc:824] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:13.062810 5087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: No bootstrap required, opened a new log
I20260808 07:02:13.064157 5087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } }
I20260808 07:02:13.064275 5087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:13.064301 5087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363cd457a64d403a8cd880eb105a87d8, State: Initialized, Role: FOLLOWER
I20260808 07:02:13.064396 5087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } }
I20260808 07:02:13.064675 5087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:13.064661 5093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } } }
I20260808 07:02:13.064756 5093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:02:13.066256 5108 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:02:13.066311 5108 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:02:13.068303 4970 master_runner.cc:428] Detected that this master 363cd457a64d403a8cd880eb105a87d8 is joining an existing cluster
I20260808 07:02:13.068343 4970 master_runner.cc:432] Initiating AddMaster RPC to add 127.26.23.188:34409
I20260808 07:02:13.075428 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.069172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33364 (local address 127.26.23.190:39323)
0808 07:02:13.069212 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.069214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.069359 (+ 145us) server_negotiation.cc:407] Connection header received
0808 07:02:13.069415 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.069415 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.069425 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.069471 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.069906 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.070450 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.071457 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.071727 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.071766 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.072685 (+ 919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.072687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.072687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.072694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.074261 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.074664 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.074665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.074665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.074723 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.074914 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.074915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.074915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.075025 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.075058 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.075270 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.075350 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:13.075711 5120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.069143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33364)
0808 07:02:13.069299 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.069308 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.069359 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.069516 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.069517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.069737 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.069815 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.069817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.070524 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.070525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.071363 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.071366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.071842 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.071843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.071886 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.072252 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.072257 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.072607 (+ 350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.074375 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.074376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.074376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.074577 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.074791 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.074792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.074792 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.074847 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.075091 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.075092 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.075145 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.075509 (+ 364us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.075607 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":106,"threads_started":1}
I20260808 07:02:13.076042 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.069494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45158 (local address 127.26.23.188:34409)
0808 07:02:13.069526 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.069528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.069535 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:13.069552 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.069553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.069561 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.069613 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.069902 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.070633 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.071616 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.071906 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.071977 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.073429 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.073430 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.073430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.073436 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.074856 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.075221 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.075222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.075223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.075275 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.075461 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.075462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.075462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.075572 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.075642 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.075886 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.075961 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:02:13.076478 5121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.069377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45158)
0808 07:02:13.069470 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.069479 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.069514 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.069621 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.069622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.069794 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.069840 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.069842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.070709 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.070710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.071525 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.071527 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.071984 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.071985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.072311 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.072730 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.072735 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.073062 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.074928 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.074929 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.074930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.075144 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.075334 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.075335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.075335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.075399 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.075655 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.075656 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.075701 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.076141 (+ 440us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.076223 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"thread_start_us":59,"threads_started":1}
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172532, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.190@KRBTEST.COM for oryx/127.26.23.188@KRBTEST.COM
I20260808 07:02:13.081404 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.078366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48460 (local address 127.26.23.189:38633)
0808 07:02:13.078406 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.078408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.078466 (+ 58us) server_negotiation.cc:407] Connection header received
0808 07:02:13.078561 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.078562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.078602 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.078681 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:13.078808 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.079533 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.080573 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.080836 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.080896 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.081089 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:13.081196 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:13.081256 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.081314 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.081335 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:02:13.081626 5121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.078368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48460)
0808 07:02:13.078426 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.078435 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.078490 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.078687 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.078687 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.078689 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:02:13.078747 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.078748 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.079606 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.079606 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.080486 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.080488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.080905 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.080907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.080974 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.080998 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:02:13.081248 (+ 250us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:02:13.081261 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.081310 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.081411 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:02:13.096704 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.077564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45172)
0808 07:02:13.077616 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.077625 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.077662 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.077782 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.077783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.077916 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.077952 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.077953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.078724 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.078725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.079529 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.079531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.079873 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.079874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.079942 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.080271 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.080276 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.081657 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.095833 (+ 14176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.095834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.095834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.096011 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.096193 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.096194 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.096194 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.096243 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.096469 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.096470 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.096506 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.096550 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.096640 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:02:13.096863 5090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.077640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.26.23.188:34409)
0808 07:02:13.077684 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.077686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.077703 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:02:13.077729 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.077730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.077738 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.077778 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.078011 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.078637 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.079623 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.079813 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.079860 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.081748 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.081750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.081750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.081756 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.095737 (+ 13981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.096077 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.096078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.096078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.096137 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.096288 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.096289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.096289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.096418 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.096481 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.096574 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.096681 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:02:13.097298 3937 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.26.23.188:34409: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "363cd457a64d403a8cd880eb105a87d8"
member_type: NON_VOTER
last_known_addr {
host: "127.26.23.188"
port: 34409
}
attrs {
promote: true
}
}
dest_uuid: "677b77c85e974c5994f5637502175827"
cas_config_opid_index: 5
I20260808 07:02:13.097525 3937 consensus_queue.cc:237] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } }
I20260808 07:02:13.097877 4820 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.098104 5043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:13.098917 4820 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.26.23.188:34409
I20260808 07:02:13.098973 5043 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Refusing update from remote peer 677b77c85e974c5994f5637502175827: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 07:02:13.098994 4820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.099054 4820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.099226 4824 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:13.099308 4970 master.cc:537] Master@127.26.23.188:34409 shutting down...
W20260808 07:02:13.100009 3915 consensus_peers.cc:487] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 -> Peer 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188:34409): Couldn't send request to peer 363cd457a64d403a8cd880eb105a87d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 07:02:13.102412 4970 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:13.102466 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.097974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48470)
0808 07:02:13.098268 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.098278 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.098323 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.098516 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.098517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.098519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.098558 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.098560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.100082 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.100083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.101342 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.101345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.102220 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.102221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.102288 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.102311 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.102365 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.102404 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278}
I20260808 07:02:13.102499 4970 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:13.102542 4970 tablet_replica.cc:330] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: stopping tablet replica
I20260808 07:02:13.102711 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.098070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48470 (local address 127.26.23.189:38633)
0808 07:02:13.098209 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.098211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.098370 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:02:13.098395 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.098396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.098418 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.098469 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.098632 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.099387 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.101443 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.102007 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.102074 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.102184 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.102593 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.102649 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260808 07:02:13.102902 4896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 LEARNER]: Refusing update from remote peer 677b77c85e974c5994f5637502175827: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 07:02:13.103089 4824 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 07:02:13.103965 4896 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
W20260808 07:02:13.104094 3861 connection.cc:535] client connection to 127.26.23.188:34409 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:02:13.105281 4970 master.cc:552] Master@127.26.23.188:34409 shutdown complete.
I20260808 07:02:13.105329 4970 master_runner.cc:305] Clearing existing system tablet
I20260808 07:02:13.105290 4946 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 677b77c85e974c5994f5637502175827. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.105382 4946 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:02:13.105422 4946 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: NON_VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: true } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.105451 4970 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:13.105464 4946 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:02:13.105489 4970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:13.105599 4824 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: attempting to promote NON_VOTER b0fe266cb41646bda51be988439109f5 to VOTER
I20260808 07:02:13.105795 4824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } }
I20260808 07:02:13.106247 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.106107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45182)
0808 07:02:13.106179 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.106221 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:34409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:02:13.106253 4970 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:13.106308 4896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 LEARNER]: Refusing update from remote peer 677b77c85e974c5994f5637502175827: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 07:02:13.106498 4819 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 07:02:13.106659 4818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.106517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45188)
0808 07:02:13.106613 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.106638 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:34409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 07:02:13.106724 3915 consensus_peers.cc:487] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 -> Peer 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188:34409): Couldn't send request to peer 363cd457a64d403a8cd880eb105a87d8. Status: Network error: Client connection negotiation failed: client connection to 127.26.23.188:34409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:02:13.106902 5126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.107003 4970 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:13.107048 4970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:02:13.107070 4970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
uuid: "363cd457a64d403a8cd880eb105a87d8"
format_stamp: "Formatted at 2026-08-08 07:02:13 on dist-test-slave-zj8q"
server_key: "a8d6d457822765a14c1456b8aa869c5f"
server_key_iv: "f60bcd9893f9500cfe27c343d0cc1c0f"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.107117 4820 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b0fe266cb41646bda51be988439109f5 (127.26.23.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.107456 4896 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, b0fe266cb41646bda51be988439109f5 (127.26.23.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.107800 4970 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:13.107929 4820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.107993 4820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.108037 4820 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.108070 4820 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.108862 4970 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 07:02:13.108918 4970 log.cc:1196] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 07:02:13.109048 4970 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Deleting consensus metadata
I20260808 07:02:13.109162 5124 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.109230 5124 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:02:13.109392 4970 master_runner.cc:315] Copying system tablet from 127.26.23.190:39323
I20260808 07:02:13.109935 4970 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: tablet copy: Beginning tablet copy session from remote peer at address 127.26.23.190:39323
I20260808 07:02:13.115310 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.110230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33366 (local address 127.26.23.190:39323)
0808 07:02:13.110271 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.110273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.110366 (+ 93us) server_negotiation.cc:407] Connection header received
0808 07:02:13.110416 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.110416 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.110426 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.110467 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.110744 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.111220 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.111957 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.112158 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.112210 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.113039 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.113040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.113040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.113047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.114361 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.114650 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.114652 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.114652 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.114705 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.114861 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.114862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.114862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.114964 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.115018 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.115159 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.115226 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:02:13.115338 5134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.110184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33366)
0808 07:02:13.110303 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.110312 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.110364 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.110479 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.110480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.110634 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.110681 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.110682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.111291 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.111292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.111886 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.111888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.112216 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.112216 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.112279 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.112677 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.112682 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.112962 (+ 280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.114427 (+ 1465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.114428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.114428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.114590 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.114756 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.114757 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.114757 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.114813 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.115015 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.115016 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.115060 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.115123 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.115225 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260808 07:02:13.115509 3963 tablet_copy_service.cc:140] P 677b77c85e974c5994f5637502175827: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 363cd457a64d403a8cd880eb105a87d8 ({username='oryx', principal='oryx/127.26.23.188@KRBTEST.COM'} at 127.0.0.1:33366)
I20260808 07:02:13.115561 3963 tablet_copy_service.cc:161] P 677b77c85e974c5994f5637502175827: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 363cd457a64d403a8cd880eb105a87d8 at {username='oryx', principal='oryx/127.26.23.188@KRBTEST.COM'} at 127.0.0.1:33366: session id = 363cd457a64d403a8cd880eb105a87d8-00000000000000000000000000000000
I20260808 07:02:13.115970 3963 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 07:02:13.116416 4970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 07:02:13.117214 4970 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: tablet copy: Starting download of 0 data blocks...
I20260808 07:02:13.117340 4970 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: tablet copy: Starting download of 1 WAL segments...
I20260808 07:02:13.118108 4970 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 07:02:13.118867 3963 tablet_copy_service.cc:342] P 677b77c85e974c5994f5637502175827: Request end of tablet copy session 363cd457a64d403a8cd880eb105a87d8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.26.23.188@KRBTEST.COM'} at 127.0.0.1:33366
I20260808 07:02:13.118929 3963 tablet_copy_service.cc:433] P 677b77c85e974c5994f5637502175827: ending tablet copy session 363cd457a64d403a8cd880eb105a87d8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 363cd457a64d403a8cd880eb105a87d8
I20260808 07:02:13.121235 4970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:13.122335 5137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.122340 5135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.122532 4970 server_base.cc:1034] running on GCE node
W20260808 07:02:13.126263 5143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.126473 4970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:13.126612 4970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:13.127733 4970 hybrid_clock.cc:648] HybridClock initialized: now 1786172533127726 us; error 23 us; skew 500 ppm
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:13.129062 4970 init.cc:377] Logged in from keytab as oryx/127.26.23.188@KRBTEST.COM (short username oryx)
I20260808 07:02:13.129335 4970 webserver.cc:460] Webserver started at http://127.26.23.188:35567/ using document root <none> and password file <none>
I20260808 07:02:13.129457 4970 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:13.129490 4970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:13.130120 4970 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.130647 5158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.130759 4970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.130813 4970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
uuid: "363cd457a64d403a8cd880eb105a87d8"
format_stamp: "Formatted at 2026-08-08 07:02:13 on dist-test-slave-zj8q"
server_key: "a8d6d457822765a14c1456b8aa869c5f"
server_key_iv: "f60bcd9893f9500cfe27c343d0cc1c0f"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.130868 4970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:13.156737 4970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:13.158381 4970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:13.161638 4970 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.188:34409
I20260808 07:02:13.161669 5231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.188:34409 every 8 connection(s)
I20260808 07:02:13.161974 4970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
I20260808 07:02:13.162719 5232 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:02:13.163115 5232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Bootstrap starting.
I20260808 07:02:13.165314 5232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:02:13.165493 5232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Bootstrap complete.
I20260808 07:02:13.165697 5232 raft_consensus.cc:348] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } }
I20260808 07:02:13.165773 5232 raft_consensus.cc:729] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 363cd457a64d403a8cd880eb105a87d8, State: Initialized, Role: LEARNER
I20260808 07:02:13.165799 5232 consensus_queue.cc:260] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } }
I20260808 07:02:13.165956 5232 sys_catalog.cc:564] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:13.165964 5235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.166177 5235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:02:13.167321 5250 catalog_manager.cc:1259] Loaded cluster ID: 7e1423a21eee408db0b85254b6cfcd64
I20260808 07:02:13.167363 5250 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: loading cluster ID for follower catalog manager: success
I20260808 07:02:13.168252 5250 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: acquiring CA information for follower catalog manager: success
I20260808 07:02:13.168504 5250 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:02:13.210706 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.204943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45204 (local address 127.26.23.188:34409)
0808 07:02:13.205084 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.205086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.205093 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:13.205116 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.205117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.205126 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.205183 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.205748 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.206419 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.207091 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.207282 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.207340 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.208528 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.208530 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.208530 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.208537 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.209685 (+ 1148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.209985 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.209987 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.209987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.210041 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.210229 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.210230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.210230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.210337 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.210424 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.210520 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.210599 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260808 07:02:13.211185 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 4035
I20260808 07:02:13.224783 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:44227
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:39323
--webserver_port=44067
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:13.307952 5253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:13.308161 5253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:13.308183 5253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:13.309345 5253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:13.309387 5253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:13.309413 5253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:13.311000 5253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:44227
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=44067
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:13.311230 5253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:13.311455 5253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:13.316355 5266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.316502 5264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.316390 5268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.316653 5253 server_base.cc:1034] running on GCE node
I20260808 07:02:13.316845 5253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:13.317081 5253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:13.318215 5253 hybrid_clock.cc:648] HybridClock initialized: now 1786172533318194 us; error 28 us; skew 500 ppm
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:13.320648 5253 init.cc:377] Logged in from keytab as oryx/127.26.23.129@KRBTEST.COM (short username oryx)
I20260808 07:02:13.321077 5253 webserver.cc:460] Webserver started at http://127.26.23.129:44067/ using document root <none> and password file <none>
I20260808 07:02:13.321302 5253 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:13.321367 5253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:13.322755 5253 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:13.323307 5281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.323457 5253 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:13.323540 5253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "e4388ab480a77665239b2d6662ec85ca"
server_key_iv: "28f42e0b9408054b0a77e95f22a82d7c"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.323870 5253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:13.374087 5253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:13.376319 5253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:13.376456 5253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:13.376698 5253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:13.376998 5253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:13.377032 5253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.377061 5253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:13.377086 5253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.382797 5253 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:44227
I20260808 07:02:13.382851 5454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:44227 every 8 connection(s)
I20260808 07:02:13.383179 5253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:13.390507 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 5253
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
I20260808 07:02:13.390695 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 4257
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.188@KRBTEST.COM
I20260808 07:02:13.394029 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.383874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:54885 (local address 127.26.23.189:38633)
0808 07:02:13.383925 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.383927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.384179 (+ 252us) server_negotiation.cc:407] Connection header received
0808 07:02:13.385360 (+ 1181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.385361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.385373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.385404 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.386138 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.386910 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388343 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.388580 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388644 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.391744 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.391746 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.391746 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.391752 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.392850 (+ 1098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.393210 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.393211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.393211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.393265 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.393473 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.393474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.393474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.393579 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.393612 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.393902 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.393965 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:02:13.394418 5461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.383888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.26.23.129:54885)
0808 07:02:13.384051 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.384091 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.385232 (+ 1141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.385484 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.385489 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.385855 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.386018 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.386025 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.386994 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.386995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.387936 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.387939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.388898 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.388992 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.389399 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.389404 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.391654 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.392922 (+ 1268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.392928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.392929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.393132 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.393320 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.393321 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.393321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.393422 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.393647 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.393651 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.393786 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.394100 (+ 314us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.394265 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":14,"thread_start_us":92,"threads_started":1}
I20260808 07:02:13.417673 5458 heartbeater.cc:347] Connected to a master server at 127.26.23.189:38633
I20260808 07:02:13.417829 5458 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.418068 5458 heartbeater.cc:511] Master 127.26.23.189:38633 requested a full tablet report, sending...
I20260808 07:02:13.418895 4882 ts_manager.cc:194] Registered new tserver with Master: b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227)
I20260808 07:02:13.420286 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.384423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:44711 (local address 127.26.23.190:39323)
0808 07:02:13.384467 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.384468 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.384475 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:13.385359 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.385361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.385373 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.385404 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.386141 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.386656 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388023 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.388223 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388278 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.390641 (+ 2363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.390643 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.390643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.390649 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.419049 (+ 28400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.419458 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.419459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.419460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.419530 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.419759 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.419760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.419761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.419889 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.419925 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.420111 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.420190 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:02:13.420300 5463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.384182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:44711)
0808 07:02:13.384296 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.384307 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.385246 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.385486 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.385489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.385850 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.386018 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.386025 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.386754 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.386754 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.387937 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.387939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.388299 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.388433 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.388915 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.388923 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.390505 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.419186 (+ 28681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.419188 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.419189 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.419384 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.419614 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.419615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.419615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.419685 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.419962 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.419963 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.420004 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.420056 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.420183 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":34,"thread_start_us":64,"threads_started":1}
I20260808 07:02:13.420889 5456 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39323
I20260808 07:02:13.420943 5456 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.421008 5456 heartbeater.cc:511] Master 127.26.23.190:39323 requested a full tablet report, sending...
I20260808 07:02:13.421268 3937 ts_manager.cc:194] Re-registered known tserver with Master: b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227)
I20260808 07:02:13.421636 3937 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:44711
I20260808 07:02:13.422308 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.384312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:46031 (local address 127.26.23.188:34409)
0808 07:02:13.384367 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.384369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.384379 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:13.385339 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.385341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.385359 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.385409 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.386107 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.386914 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388737 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.389046 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.389144 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.418716 (+ 29572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.418718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.418719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.418729 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.420366 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.420761 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.420763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.420763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.420831 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.421751 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.421752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.421753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.421900 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.421969 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.422111 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.422220 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:02:13.422313 5462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.383890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.26.23.129:46031)
0808 07:02:13.384071 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.384096 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.385236 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.385485 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.385489 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.385803 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.386016 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.386021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.388030 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.388030 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.388677 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.388680 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.389149 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.389150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.389213 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.389522 (+ 309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.389527 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.418473 (+ 28946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.420466 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.420467 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.420468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.420681 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.421081 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.421082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.421082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.421144 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.421959 (+ 815us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.421960 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.422007 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.422069 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.422206 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260808 07:02:13.422696 5455 heartbeater.cc:347] Connected to a master server at 127.26.23.188:34409
I20260808 07:02:13.422750 5455 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.422817 5455 heartbeater.cc:511] Master 127.26.23.188:34409 requested a full tablet report, sending...
I20260808 07:02:13.423048 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:45935
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:39323
--webserver_port=43769
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:02:13.424696 5182 ts_manager.cc:194] Registered new tserver with Master: b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227)
W20260808 07:02:13.505101 5464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:13.505300 5464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:13.505322 5464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:13.506481 5464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:13.506520 5464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:13.506546 5464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:13.508023 5464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:45935
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=43769
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:13.508242 5464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:13.508455 5464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:13.513604 5473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.513712 5464 server_base.cc:1034] running on GCE node
W20260808 07:02:13.513631 5478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.513662 5474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.513972 5464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:13.514271 5464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:13.515414 5464 hybrid_clock.cc:648] HybridClock initialized: now 1786172533515405 us; error 31 us; skew 500 ppm
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:13.517935 5464 init.cc:377] Logged in from keytab as oryx/127.26.23.130@KRBTEST.COM (short username oryx)
I20260808 07:02:13.518410 5464 webserver.cc:460] Webserver started at http://127.26.23.130:43769/ using document root <none> and password file <none>
I20260808 07:02:13.518620 5464 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:13.518685 5464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:13.520001 5464 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:13.520555 5485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.520694 5464 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:13.520780 5464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "aee349deaffd4bda83e8a2e44c385793"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "c306e4dccc5ebc599efc0d288d557c65"
server_key_iv: "fa1bd9e91c603af48f546768b4212ac8"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.521119 5464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:13.535190 5464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:13.537195 5464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:13.537317 5464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:13.537501 5464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:13.537774 5464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:13.537806 5464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.537834 5464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:13.537858 5464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.543453 5464 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:45935
I20260808 07:02:13.543516 5677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:45935 every 8 connection(s)
I20260808 07:02:13.543812 5464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:13.548249 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 5464
I20260808 07:02:13.548403 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 4472
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.188@KRBTEST.COM
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
I20260808 07:02:13.556273 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.544458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:54511 (local address 127.26.23.189:38633)
0808 07:02:13.544521 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.544524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.544846 (+ 322us) server_negotiation.cc:407] Connection header received
0808 07:02:13.545392 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.545393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.545407 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.545455 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.546327 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.547102 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548130 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.548436 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548473 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.553205 (+ 4732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.553207 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.553208 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.553215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.554736 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.555135 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.555136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.555137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.555204 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.555495 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.555496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.555497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.555650 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.555695 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.556083 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.556179 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:13.556804 5685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.544467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.26.23.130:54511)
0808 07:02:13.544771 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.544781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.545299 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.545897 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.545898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.546039 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.546243 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.546248 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.547185 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.547186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.548025 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.548027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.551273 (+ 3246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.551274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.551342 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.551714 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.551718 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.553098 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.554824 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.554825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.554825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.555032 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.555283 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.555283 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.555284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.555419 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.555741 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.555748 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.555914 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.556397 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.556582 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":46,"thread_start_us":92,"threads_started":1}
I20260808 07:02:13.557530 5686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.544791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:35495)
0808 07:02:13.544925 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.544934 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.545299 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.545713 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.545714 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.545954 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.546244 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.546251 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.546950 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.546950 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.548034 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.548036 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.548544 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.548646 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.549131 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.549136 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.551161 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.555854 (+ 4693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.555855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.555855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.556040 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.556547 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.556548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.556548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.556612 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.557251 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.557252 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.557283 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.557334 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.557429 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":24,"thread_start_us":61,"threads_started":1}
I20260808 07:02:13.557539 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.544894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:35495 (local address 127.26.23.190:39323)
0808 07:02:13.544955 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.544957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.544966 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:13.545608 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.545610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.545623 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.545673 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.546356 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.546852 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548124 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.548433 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548472 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.554197 (+ 5725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.554198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.554199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.554208 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.555778 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.556420 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.556421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.556422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.556480 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.557043 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.557044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.557044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.557179 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.557215 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.557383 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.557455 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:02:13.557817 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.544520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:41329 (local address 127.26.23.188:34409)
0808 07:02:13.544618 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.544620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.544845 (+ 225us) server_negotiation.cc:407] Connection header received
0808 07:02:13.545466 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.545467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.545480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.545544 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.546361 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.547113 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.547969 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.548263 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548329 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.551794 (+ 3465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.551795 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.551796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.551802 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.553313 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.556160 (+ 2847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.556161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.556162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.556222 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.556691 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.556692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.556692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.556819 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.556872 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.557684 (+ 812us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.557761 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:13.558054 5684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.544467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.26.23.130:41329)
0808 07:02:13.544669 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.544709 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.545287 (+ 578us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.545556 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.545560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.545955 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.546244 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.546251 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.547215 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.547216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.547896 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.547898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.548437 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.548439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.548604 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.549086 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.549097 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.551694 (+ 2597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.553397 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.553404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.553407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.556092 (+ 2685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.556289 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.556290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.556290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.556345 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.556906 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.556907 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.556949 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.557885 (+ 936us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.557979 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":38,"thread_start_us":97,"threads_started":1}
I20260808 07:02:13.564370 5682 heartbeater.cc:347] Connected to a master server at 127.26.23.189:38633
I20260808 07:02:13.564373 5681 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39323
I20260808 07:02:13.564494 5682 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.564718 5682 heartbeater.cc:511] Master 127.26.23.189:38633 requested a full tablet report, sending...
I20260808 07:02:13.565022 5679 heartbeater.cc:347] Connected to a master server at 127.26.23.188:34409
I20260808 07:02:13.565096 5679 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.565160 5679 heartbeater.cc:511] Master 127.26.23.188:34409 requested a full tablet report, sending...
I20260808 07:02:13.565375 4882 ts_manager.cc:194] Registered new tserver with Master: aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935)
I20260808 07:02:13.564494 5681 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.565704 5681 heartbeater.cc:511] Master 127.26.23.190:39323 requested a full tablet report, sending...
I20260808 07:02:13.565970 5182 ts_manager.cc:194] Registered new tserver with Master: aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935)
I20260808 07:02:13.566224 3937 ts_manager.cc:194] Re-registered known tserver with Master: aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935)
I20260808 07:02:13.566769 3937 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:35495
I20260808 07:02:13.569008 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:33641
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:39323
--webserver_port=33473
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:13.650238 5689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:13.650429 5689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:13.650460 5689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:13.651563 5689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:13.651603 5689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:13.651638 5689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:13.653059 5689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:33641
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=33473
--tserver_master_addrs=127.26.23.190:39323,127.26.23.189:38633,127.26.23.188:34409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:13.653307 5689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:13.653505 5689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:13.658180 5700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.658253 5697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:13.658252 5704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:13.658447 5689 server_base.cc:1034] running on GCE node
I20260808 07:02:13.658775 5689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:13.658972 5689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:13.660110 5689 hybrid_clock.cc:648] HybridClock initialized: now 1786172533660098 us; error 29 us; skew 500 ppm
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:13.662592 5689 init.cc:377] Logged in from keytab as oryx/127.26.23.131@KRBTEST.COM (short username oryx)
I20260808 07:02:13.662971 5689 webserver.cc:460] Webserver started at http://127.26.23.131:33473/ using document root <none> and password file <none>
I20260808 07:02:13.663157 5689 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:13.663220 5689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:13.664522 5689 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:13.665041 5716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.665196 5689 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.665277 5689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "3a56aa865e064b658acca483187d8ffa"
format_stamp: "Formatted at 2026-08-08 07:02:12 on dist-test-slave-zj8q"
server_key: "996a6e71cad75b90671f31569b3e0826"
server_key_iv: "08dfee0e0765432b1f5bb0793c9a89db"
server_key_version: "encryptionkey@0"
I20260808 07:02:13.665581 5689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:13.673452 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.670727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45218)
0808 07:02:13.670851 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.670859 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.670925 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.671066 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.671067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.671070 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.671130 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.671133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.671811 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.671812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.672572 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.672575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.673178 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.673180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.673270 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.673275 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.673320 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.673373 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":44,"threads_started":1}
I20260808 07:02:13.673445 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.670756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45218 (local address 127.26.23.188:34409)
0808 07:02:13.670804 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.670806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.670914 (+ 108us) server_negotiation.cc:407] Connection header received
0808 07:02:13.670980 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.670980 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.671005 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.671055 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.671188 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.671680 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.672669 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.673097 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.673164 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.673222 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.673344 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.673382 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:02:13.673944 5195 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 07:02:13.674171 5726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 677b77c85e974c5994f5637502175827. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.674315 5726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: This master's current role is: LEARNER
I20260808 07:02:13.686957 5689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:13.688611 5689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:13.688727 5689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:13.688932 5689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:13.689206 5689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:13.689239 5689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.689260 5689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:13.689282 5689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:13.694706 5689 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:33641
I20260808 07:02:13.694783 5908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:33641 every 8 connection(s)
I20260808 07:02:13.695068 5689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.188@KRBTEST.COM
Aug 08 07:02:13 dist-test-slave-zj8q krb5kdc[3864](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172533, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.189@KRBTEST.COM
I20260808 07:02:13.704016 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 5689
I20260808 07:02:13.706420 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.695732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38365 (local address 127.26.23.190:39323)
0808 07:02:13.695779 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.695781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.695984 (+ 203us) server_negotiation.cc:407] Connection header received
0808 07:02:13.696539 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.696541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.696563 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.696592 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.697495 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.698246 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699348 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.699647 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699708 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.702208 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.702210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.702211 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.702218 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.703721 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705004 (+ 1283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.705005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.705006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.705067 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705637 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.705638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.705638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.705775 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.705838 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.706252 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.706332 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:02:13.706547 5920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.695744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.26.23.131:45269)
0808 07:02:13.696068 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.696077 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.696427 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.696671 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.696676 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.697171 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.697376 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.697383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.699101 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.699815 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.699817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.700680 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.700682 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.700750 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.701129 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.701134 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.703213 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.704748 (+ 1535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.704749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.704749 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.704933 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.705603 (+ 670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.705604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.705679 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.705975 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.705976 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.706034 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.706142 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.706331 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":6,"thread_start_us":76,"threads_started":1}
I20260808 07:02:13.706574 5918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.695959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.26.23.131:35549)
0808 07:02:13.696110 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.696119 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.696432 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.696911 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.696911 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.697168 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.697375 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.697380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.698331 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.698332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.699352 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.699355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.699813 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.699894 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.700448 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.700453 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.702902 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.705566 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705567 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.705567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.705781 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.705968 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705968 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.705969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.706022 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.706316 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.706317 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.706352 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.706409 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.706488 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":28,"thread_start_us":64,"threads_started":1}
I20260808 07:02:13.706715 5917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.695690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:38365)
0808 07:02:13.695863 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.695902 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.696425 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.696671 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.696676 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.697169 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:13.697376 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.697383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.698351 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.698352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.699271 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.699273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.699718 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.699889 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.700402 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:13.700410 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:13.702078 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:13.703797 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.703804 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.703807 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.704101 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.705137 (+ 1036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705137 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:13.705137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:13.705278 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:13.705867 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:13.705875 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:13.706032 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.706140 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.706598 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":337,"thread_start_us":80,"threads_started":1}
I20260808 07:02:13.706981 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.696033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:35549 (local address 127.26.23.188:34409)
0808 07:02:13.696072 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.696074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.696177 (+ 103us) server_negotiation.cc:407] Connection header received
0808 07:02:13.696506 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.696507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.696519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.696570 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.697467 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.698233 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699434 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.699708 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699761 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.702970 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.702971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.702971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.702979 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.705492 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705853 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.705854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.705854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.705905 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.706087 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.706087 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.706088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.706232 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.706288 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.706801 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.706886 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:13.707062 5912 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39323
I20260808 07:02:13.707140 5912 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.707340 4966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.695815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:45269 (local address 127.26.23.189:38633)
0808 07:02:13.695857 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.695859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.696130 (+ 271us) server_negotiation.cc:407] Connection header received
0808 07:02:13.696543 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.696545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.696558 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.696591 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.698241 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.698989 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.699907 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.700576 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.700659 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.703292 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.703294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.703294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.703300 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.704661 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705477 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.705479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.705479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.705552 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.705755 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.705757 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.705757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.705892 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.705951 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.707177 (+ 1226us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.707258 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:02:13.707605 5914 heartbeater.cc:347] Connected to a master server at 127.26.23.189:38633
I20260808 07:02:13.707669 5914 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.707724 5914 heartbeater.cc:511] Master 127.26.23.189:38633 requested a full tablet report, sending...
I20260808 07:02:13.707347 5912 heartbeater.cc:511] Master 127.26.23.190:39323 requested a full tablet report, sending...
I20260808 07:02:13.708199 4882 ts_manager.cc:194] Registered new tserver with Master: 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:13.708433 3937 ts_manager.cc:194] Re-registered known tserver with Master: 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:13.708601 5909 heartbeater.cc:347] Connected to a master server at 127.26.23.188:34409
I20260808 07:02:13.708650 5909 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:13.708703 5909 heartbeater.cc:511] Master 127.26.23.188:34409 requested a full tablet report, sending...
I20260808 07:02:13.708889 3937 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:38365
I20260808 07:02:13.708957 5182 ts_manager.cc:194] Registered new tserver with Master: 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:13.713117 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.704970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33378 (local address 127.26.23.190:39323)
0808 07:02:13.705447 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.705449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.705457 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:13.705502 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.705503 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.705526 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.705588 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.706396 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.707546 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.708476 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.708750 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.708802 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.710100 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.710102 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.710102 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.710109 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.711880 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.712228 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.712229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.712229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.712288 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.712484 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.712485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.712485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.712617 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.712716 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.712947 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.713023 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":61,"threads_started":1}
I20260808 07:02:13.715878 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.705395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45234 (local address 127.26.23.188:34409)
0808 07:02:13.707048 (+ 1653us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.707050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.708678 (+ 1628us) server_negotiation.cc:407] Connection header received
0808 07:02:13.709395 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.709396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.709408 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.709435 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.710000 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.710612 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.711437 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.711716 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.711783 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.713061 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.713062 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.713063 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.713069 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.714878 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.715249 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.715250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.715251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.715306 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.715455 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.715455 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.715456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.715575 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.715673 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.715729 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.715797 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1638,"thread_start_us":46,"threads_started":1}
I20260808 07:02:13.715029 3937 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:13.716905 3937 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:13.717597 4824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: NON_VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: true } } }
I20260808 07:02:13.717696 4824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.718024 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.705095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48486 (local address 127.26.23.189:38633)
0808 07:02:13.705332 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.705334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.708253 (+ 2919us) server_negotiation.cc:407] Connection header received
0808 07:02:13.708492 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.708493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.708506 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.708557 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.709373 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.710046 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.711012 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.711524 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.711579 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.713239 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.713241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.713241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.713247 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.714803 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.717269 (+ 2466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.717270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.717270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.717324 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.717515 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.717516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.717517 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.717641 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.717824 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.717862 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.717940 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":50,"threads_started":1}
I20260808 07:02:13.719041 4824 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: attempting to promote NON_VOTER 363cd457a64d403a8cd880eb105a87d8 to VOTER
I20260808 07:02:13.719183 4824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:13.719530 4896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Refusing update from remote peer 677b77c85e974c5994f5637502175827: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 07:02:13.719802 5194 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 LEARNER]: Refusing update from remote peer 677b77c85e974c5994f5637502175827: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 07:02:13.719800 5942 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 07:02:13.720052 5942 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 07:02:13.720523 5942 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.720981 5195 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.721341 5944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.721437 5944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.721360 4824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.721472 4824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.721603 4896 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.721343 5942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.721897 5942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:13.721923 5726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.722000 5726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:02:13.722872 5962 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "677b77c85e974c5994f5637502175827" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:13.722968 5962 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:02:13.726684 5725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.722501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44227 (local address 127.0.0.1:46866)
0808 07:02:13.722586 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.722596 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.722633 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.723367 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.723368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.723394 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.723438 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.723439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.724830 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.724832 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.725606 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.725609 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.726461 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.726462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.726525 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.726529 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.726571 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.726616 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":45}
I20260808 07:02:13.726959 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.722716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46866 (local address 127.26.23.129:44227)
0808 07:02:13.723204 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.723209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.723219 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:13.723255 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.723257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.723273 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.723515 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.723633 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.724746 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.725692 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.726381 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.726453 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.726775 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.726809 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.726874 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":91,"threads_started":1}
I20260808 07:02:13.727211 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.723247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60490 (local address 127.26.23.131:33641)
0808 07:02:13.723566 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.723569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.723595 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:02:13.723628 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.723630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.723644 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.723908 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.723963 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.724700 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.726197 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.726896 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.726958 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.727031 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.727101 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.727136 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":71,"threads_started":1}
I20260808 07:02:13.727203 5968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.723069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:33641 (local address 127.0.0.1:60490)
0808 07:02:13.723437 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.723446 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.723488 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.723738 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.723739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.723741 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.723791 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.723793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.724766 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.724767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.726001 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.726004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.726968 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.726969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.727028 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.727033 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.727087 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.727135 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":37,"thread_start_us":75,"threads_started":1}
I20260808 07:02:13.727684 5350 tablet_service.cc:1467] Processing CreateTablet for tablet 82d2286adf5944e49a1a673213253fd6 (DEFAULT_TABLE table=test-table [id=3871f48ed90e4b0b83808b0415fafc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:13.727778 5798 tablet_service.cc:1467] Processing CreateTablet for tablet 82d2286adf5944e49a1a673213253fd6 (DEFAULT_TABLE table=test-table [id=3871f48ed90e4b0b83808b0415fafc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:13.727926 5964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.722602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:45935 (local address 127.0.0.1:45112)
0808 07:02:13.722737 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.722746 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.722790 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.723160 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.723161 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.723163 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.723211 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.723213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.724835 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.724836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.726001 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.726004 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.727691 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.727692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.727755 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.727759 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.727825 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.727866 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":26,"thread_start_us":78,"threads_started":1}
I20260808 07:02:13.728093 5350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d2286adf5944e49a1a673213253fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:13.728130 5798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d2286adf5944e49a1a673213253fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:13.728171 5966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.722819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45112 (local address 127.26.23.130:45935)
0808 07:02:13.722990 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.722995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.723006 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:13.723045 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.723047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.723064 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.723151 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.723302 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.724727 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.726080 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.727608 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.727687 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.727759 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.727840 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.728091 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":102,"threads_started":1}
I20260808 07:02:13.728770 5560 tablet_service.cc:1467] Processing CreateTablet for tablet 82d2286adf5944e49a1a673213253fd6 (DEFAULT_TABLE table=test-table [id=3871f48ed90e4b0b83808b0415fafc6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:13.729076 5560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d2286adf5944e49a1a673213253fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:13.731220 5971 tablet_bootstrap.cc:492] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Bootstrap starting.
I20260808 07:02:13.731540 5973 tablet_bootstrap.cc:492] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Bootstrap starting.
I20260808 07:02:13.732028 5971 tablet_bootstrap.cc:654] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:13.732206 5973 tablet_bootstrap.cc:654] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:13.732304 5974 tablet_bootstrap.cc:492] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Bootstrap starting.
I20260808 07:02:13.732533 5973 log.cc:824] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:13.732676 5971 log.cc:824] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:13.732930 5974 tablet_bootstrap.cc:654] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:13.733239 5974 log.cc:824] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:13.733449 5973 tablet_bootstrap.cc:492] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: No bootstrap required, opened a new log
I20260808 07:02:13.733505 5973 ts_tablet_manager.cc:1397] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:13.733903 5974 tablet_bootstrap.cc:492] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: No bootstrap required, opened a new log
I20260808 07:02:13.733958 5974 ts_tablet_manager.cc:1397] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:13.734601 5971 tablet_bootstrap.cc:492] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: No bootstrap required, opened a new log
I20260808 07:02:13.734673 5971 ts_tablet_manager.cc:1397] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 07:02:13.735394 5974 raft_consensus.cc:348] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.735517 5974 raft_consensus.cc:374] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:13.735551 5974 raft_consensus.cc:729] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee349deaffd4bda83e8a2e44c385793, State: Initialized, Role: FOLLOWER
I20260808 07:02:13.735682 5974 consensus_queue.cc:260] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.735823 5973 raft_consensus.cc:348] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.735941 5974 ts_tablet_manager.cc:1428] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:02:13.735978 5973 raft_consensus.cc:374] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:13.736019 5681 heartbeater.cc:503] Master 127.26.23.190:39323 was elected leader, sending a full tablet report...
I20260808 07:02:13.736012 5973 raft_consensus.cc:729] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a56aa865e064b658acca483187d8ffa, State: Initialized, Role: FOLLOWER
I20260808 07:02:13.736129 5973 consensus_queue.cc:260] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.736377 5973 ts_tablet_manager.cc:1428] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:02:13.736593 5971 raft_consensus.cc:348] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.736717 5971 raft_consensus.cc:374] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:13.736760 5971 raft_consensus.cc:729] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ac9db9c45546bdb7c8d7b7b7b88e00, State: Initialized, Role: FOLLOWER
I20260808 07:02:13.736876 5971 consensus_queue.cc:260] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.737110 5971 ts_tablet_manager.cc:1428] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:02:13.737146 5456 heartbeater.cc:503] Master 127.26.23.190:39323 was elected leader, sending a full tablet report...
I20260808 07:02:13.737535 5912 heartbeater.cc:503] Master 127.26.23.190:39323 was elected leader, sending a full tablet report...
W20260808 07:02:13.794796 5683 tablet.cc:2369] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:02:13.884123 5460 tablet.cc:2369] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:13.898438 5982 raft_consensus.cc:482] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:13.898561 5982 raft_consensus.cc:504] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.898928 5982 leader_election.cc:288] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935), 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:13.902770 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.899567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:43007 (local address 127.26.23.131:33641)
0808 07:02:13.899610 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.899612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.899619 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:13.899658 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.899659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.899668 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.899717 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.899907 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.900593 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.901762 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.902374 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.902448 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.902457 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.902601 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.902676 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:02:13.903038 5463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.899101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:33641 (local address 127.26.23.129:43007)
0808 07:02:13.899348 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.899360 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.899413 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.899773 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.899775 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.899777 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.899834 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.899836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.900666 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.900667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.901683 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.901687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.902455 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.902456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.902514 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.902519 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.902572 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.902619 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260808 07:02:13.903247 5462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.899217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:45935 (local address 127.26.23.129:43351)
0808 07:02:13.899401 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:13.899413 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:13.899526 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:13.899854 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:13.899996 (+ 142us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:13.899998 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:13.900396 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.900399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.901263 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.901265 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.902228 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:13.902232 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.902973 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.902974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:13.903056 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.903060 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:13.903114 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:02:13.903162 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260808 07:02:13.903519 5966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.899208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:43351 (local address 127.26.23.130:45935)
0808 07:02:13.899260 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.899261 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.899497 (+ 236us) server_negotiation.cc:407] Connection header received
0808 07:02:13.899690 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.899691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.899702 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.899774 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:13.900484 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.901160 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.902328 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.902864 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.902932 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.902940 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.903415 (+ 475us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.903458 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:02:13.903475 5835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d2286adf5944e49a1a673213253fd6" candidate_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a56aa865e064b658acca483187d8ffa" is_pre_election: true
I20260808 07:02:13.903650 5835 raft_consensus.cc:2454] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ac9db9c45546bdb7c8d7b7b7b88e00 in term 0.
I20260808 07:02:13.903857 5597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d2286adf5944e49a1a673213253fd6" candidate_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee349deaffd4bda83e8a2e44c385793" is_pre_election: true
I20260808 07:02:13.903910 5284 leader_election.cc:302] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a56aa865e064b658acca483187d8ffa, b8ac9db9c45546bdb7c8d7b7b7b88e00; no voters:
I20260808 07:02:13.904013 5597 raft_consensus.cc:2454] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8ac9db9c45546bdb7c8d7b7b7b88e00 in term 0.
I20260808 07:02:13.904028 5982 raft_consensus.cc:2781] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:13.904148 5982 raft_consensus.cc:482] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:13.904198 5982 raft_consensus.cc:3037] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:13.905033 5982 raft_consensus.cc:504] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.905224 5982 leader_election.cc:288] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [CANDIDATE]: Term 1 election: Requested vote from peers aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935), 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:13.905311 5597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d2286adf5944e49a1a673213253fd6" candidate_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aee349deaffd4bda83e8a2e44c385793"
I20260808 07:02:13.905382 5597 raft_consensus.cc:3037] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:13.905427 5835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d2286adf5944e49a1a673213253fd6" candidate_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a56aa865e064b658acca483187d8ffa"
I20260808 07:02:13.905503 5835 raft_consensus.cc:3037] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:13.906278 5597 raft_consensus.cc:2454] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ac9db9c45546bdb7c8d7b7b7b88e00 in term 1.
I20260808 07:02:13.906338 5835 raft_consensus.cc:2454] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8ac9db9c45546bdb7c8d7b7b7b88e00 in term 1.
I20260808 07:02:13.906468 5288 leader_election.cc:302] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee349deaffd4bda83e8a2e44c385793, b8ac9db9c45546bdb7c8d7b7b7b88e00; no voters:
I20260808 07:02:13.906553 5982 raft_consensus.cc:2781] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:13.906662 5982 raft_consensus.cc:686] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 LEADER]: Becoming Leader. State: Replica: b8ac9db9c45546bdb7c8d7b7b7b88e00, State: Running, Role: LEADER
I20260808 07:02:13.906756 5982 consensus_queue.cc:237] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } }
I20260808 07:02:13.911523 3937 catalog_manager.cc:5495] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129). New cstate: current_term: 1 leader_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } health_report { overall_health: UNKNOWN } } }
W20260808 07:02:13.945708 5916 tablet.cc:2369] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:13.950542 5965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.948204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46874 (local address 127.26.23.129:44227)
0808 07:02:13.948249 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.948251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.948260 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:13.948322 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.948323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.948345 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.948406 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:13.948538 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.949050 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.949788 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.949996 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.950057 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.950229 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:13.950338 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:13.950408 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.950444 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.950466 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:02:13.952275 5597 raft_consensus.cc:1261] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Refusing update from remote peer b8ac9db9c45546bdb7c8d7b7b7b88e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:13.952275 5835 raft_consensus.cc:1261] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Refusing update from remote peer b8ac9db9c45546bdb7c8d7b7b7b88e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:13.952670 5983 consensus_queue.cc:1035] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:13.952804 5982 consensus_queue.cc:1035] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:13.957526 5989 mvcc.cc:205] Tried to move back new op lower bound from 7316162699066036224 to 7316162698882621440. Current Snapshot: MvccSnapshot[applied={T|T < 7316162699066036224}]
I20260808 07:02:13.958376 3937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:13.958470 3937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:13.959882 3937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 677b77c85e974c5994f5637502175827: Sending DeleteTablet for 3 replicas of tablet 82d2286adf5944e49a1a673213253fd6
I20260808 07:02:13.960177 5798 tablet_service.cc:1514] Processing DeleteTablet for tablet 82d2286adf5944e49a1a673213253fd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:13 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:60490
I20260808 07:02:13.960189 5560 tablet_service.cc:1514] Processing DeleteTablet for tablet 82d2286adf5944e49a1a673213253fd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:13 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:45112
I20260808 07:02:13.960305 5350 tablet_service.cc:1514] Processing DeleteTablet for tablet 82d2286adf5944e49a1a673213253fd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:13 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:46866
I20260808 07:02:13.960400 6003 tablet_replica.cc:330] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: stopping tablet replica
I20260808 07:02:13.960492 6003 raft_consensus.cc:2229] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:13.960583 6004 tablet_replica.cc:330] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: stopping tablet replica
I20260808 07:02:13.960595 6003 raft_consensus.cc:2258] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:13.960664 6004 raft_consensus.cc:2229] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:13.961100 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 3885
I20260808 07:02:13.961127 6004 raft_consensus.cc:2258] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:13.966463 6003 ts_tablet_manager.cc:1905] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:13.968022 6003 ts_tablet_manager.cc:1918] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:13.968081 6003 log.cc:1196] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/82d2286adf5944e49a1a673213253fd6
I20260808 07:02:13.968300 6003 ts_tablet_manager.cc:1939] T 82d2286adf5944e49a1a673213253fd6 P 3a56aa865e064b658acca483187d8ffa: Deleting consensus metadata
I20260808 07:02:13.974794 6002 tablet_replica.cc:330] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: stopping tablet replica
I20260808 07:02:13.974929 6002 raft_consensus.cc:2229] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:13.975044 6002 raft_consensus.cc:2258] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:13.975152 6004 ts_tablet_manager.cc:1905] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:13.975499 6002 ts_tablet_manager.cc:1905] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:13.976760 6004 ts_tablet_manager.cc:1918] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:13.976832 6004 log.cc:1196] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/82d2286adf5944e49a1a673213253fd6
I20260808 07:02:13.977057 6002 ts_tablet_manager.cc:1918] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:13.977097 6004 ts_tablet_manager.cc:1939] T 82d2286adf5944e49a1a673213253fd6 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Deleting consensus metadata
I20260808 07:02:13.977121 6002 log.cc:1196] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/82d2286adf5944e49a1a673213253fd6
I20260808 07:02:13.977347 6002 ts_tablet_manager.cc:1939] T 82d2286adf5944e49a1a673213253fd6 P aee349deaffd4bda83e8a2e44c385793: Deleting consensus metadata
W20260808 07:02:13.980247 5723 connection.cc:535] server connection from 127.0.0.1:60490 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:02:13.980258 5493 connection.cc:535] server connection from 127.0.0.1:45112 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 07:02:13.980367 5285 connection.cc:535] server connection from 127.0.0.1:46866 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:02:13.989974 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.982211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.26.23.189:38633)
0808 07:02:13.982274 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.982276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.982542 (+ 266us) server_negotiation.cc:407] Connection header received
0808 07:02:13.982608 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.982609 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.982622 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.982675 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.983365 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.983865 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.984847 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.985036 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.985077 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.986551 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.986553 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.986553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.986560 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.988589 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.989174 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.989175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.989176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.989244 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.989443 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.989444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.989444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.989574 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.989673 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.989786 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.989874 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:02:13.992339 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:13.982363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45248 (local address 127.26.23.188:34409)
0808 07:02:13.982409 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:13.982411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:13.986318 (+ 3907us) server_negotiation.cc:407] Connection header received
0808 07:02:13.986377 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:13.986378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:13.986390 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:13.986434 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:13.986983 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.987455 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.988370 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:13.988672 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:13.988742 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:13.989832 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:13.989834 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:13.989834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:13.989841 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:13.991397 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.991691 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.991692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.991692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.991743 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:13.991904 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:13.991905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:13.991906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:13.992002 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:13.992092 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:13.992181 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:02:13.992253 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:14.956607 6017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:14.956352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:48709)
0808 07:02:14.956480 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:14.956559 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
W20260808 07:02:14.956875 5912 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:39323 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:14.957414 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:14.957189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:51545)
0808 07:02:14.957289 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:14.957369 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":48,"threads_started":1}
W20260808 07:02:14.957607 5456 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:39323 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:14.958647 6021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:14.958443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:46143)
0808 07:02:14.958525 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:14.958588 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68,"thread_start_us":45,"threads_started":1}
W20260808 07:02:14.958837 5681 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:39323 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:15.460233 6026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 677b77c85e974c5994f5637502175827)
I20260808 07:02:15.460244 6024 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 677b77c85e974c5994f5637502175827)
I20260808 07:02:15.460373 6026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:15.460387 6024 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:15.460692 6024 leader_election.cc:288] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 677b77c85e974c5994f5637502175827 (127.26.23.190:39323), 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188:34409)
I20260808 07:02:15.461005 6027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.460799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33848)
0808 07:02:15.460908 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.460959 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":49,"threads_started":1}
I20260808 07:02:15.461126 6031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.460801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33844)
0808 07:02:15.461022 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.461085 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":43,"threads_started":1}
W20260808 07:02:15.461112 4860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
W20260808 07:02:15.461243 5162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:15.460666 6026 leader_election.cc:288] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 677b77c85e974c5994f5637502175827 (127.26.23.190:39323), b0fe266cb41646bda51be988439109f5 (127.26.23.189:38633)
I20260808 07:02:15.461586 6034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.461493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33858)
0808 07:02:15.461531 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.461556 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:02:15.461658 6028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.461539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33862)
0808 07:02:15.461575 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.461597 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:02:15.461663 4860 leader_election.cc:334] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
W20260808 07:02:15.461731 5162 leader_election.cc:334] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:15.464941 6035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.461176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45258 (local address 127.26.23.188:34409)
0808 07:02:15.461472 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:15.461474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:15.461481 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:15.461500 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:15.461501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:15.461510 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:15.461865 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:15.461898 (+ 33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.462627 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.463946 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.464535 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.464615 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:15.464631 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:15.464794 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 07:02:15.464839 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":53,"threads_started":1}
I20260808 07:02:15.464939 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.460891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48510 (local address 127.26.23.189:38633)
0808 07:02:15.461350 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:15.461352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:15.461360 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:15.461387 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:15.461387 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:15.461398 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:15.461450 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:15.461647 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.462491 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.463946 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.464594 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.464656 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:15.464667 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:15.464794 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 07:02:15.464837 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":443,"thread_start_us":61,"threads_started":1}
I20260808 07:02:15.464960 6027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.460940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:34409 (local address 127.0.0.1:45258)
0808 07:02:15.461067 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.461077 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:15.461135 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:15.461605 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:15.461606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:15.461609 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:15.461797 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:15.461799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.462696 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.462697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:15.463849 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:15.463851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.464617 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.464618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:15.464721 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:15.464727 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:02:15.464784 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:02:15.464827 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":48,"threads_started":1}
I20260808 07:02:15.464960 6031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.460850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:38633 (local address 127.0.0.1:48510)
0808 07:02:15.461193 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.461203 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:15.461265 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:15.461502 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:15.461503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:15.461506 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:15.461581 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:15.461583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.462575 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.462576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:15.463840 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:15.463844 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:15.464665 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:15.464666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:15.464725 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:15.464730 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:02:15.464784 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:02:15.464829 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":53,"threads_started":1}
I20260808 07:02:15.465425 4896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "363cd457a64d403a8cd880eb105a87d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b0fe266cb41646bda51be988439109f5" is_pre_election: true
I20260808 07:02:15.465401 5195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0fe266cb41646bda51be988439109f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "363cd457a64d403a8cd880eb105a87d8" is_pre_election: true
I20260808 07:02:15.465531 4896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363cd457a64d403a8cd880eb105a87d8 in term 1.
I20260808 07:02:15.465588 5195 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fe266cb41646bda51be988439109f5 in term 1.
I20260808 07:02:15.465691 5160 leader_election.cc:302] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363cd457a64d403a8cd880eb105a87d8, b0fe266cb41646bda51be988439109f5; no voters: 677b77c85e974c5994f5637502175827
I20260808 07:02:15.465792 6026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:02:15.465833 6026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 677b77c85e974c5994f5637502175827)
I20260808 07:02:15.465854 6026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:02:15.465862 4860 leader_election.cc:302] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363cd457a64d403a8cd880eb105a87d8, b0fe266cb41646bda51be988439109f5; no voters: 677b77c85e974c5994f5637502175827
I20260808 07:02:15.465956 6024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 07:02:15.465997 6024 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 677b77c85e974c5994f5637502175827)
I20260808 07:02:15.466030 6024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:02:15.466712 6026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:15.466837 6026 leader_election.cc:288] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 2 election: Requested vote from peers 677b77c85e974c5994f5637502175827 (127.26.23.190:39323), b0fe266cb41646bda51be988439109f5 (127.26.23.189:38633)
I20260808 07:02:15.466802 6024 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:15.466919 6024 leader_election.cc:288] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [CANDIDATE]: Term 2 election: Requested vote from peers 677b77c85e974c5994f5637502175827 (127.26.23.190:39323), 363cd457a64d403a8cd880eb105a87d8 (127.26.23.188:34409)
I20260808 07:02:15.466986 6031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.466909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33874)
0808 07:02:15.466938 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.466965 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260808 07:02:15.467051 4896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "363cd457a64d403a8cd880eb105a87d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b0fe266cb41646bda51be988439109f5"
I20260808 07:02:15.467099 6027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.467002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33886)
0808 07:02:15.467038 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.467065 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 07:02:15.467131 4896 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 363cd457a64d403a8cd880eb105a87d8 in current term 2: Already voted for candidate b0fe266cb41646bda51be988439109f5 in this term.
I20260808 07:02:15.467129 5195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b0fe266cb41646bda51be988439109f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "363cd457a64d403a8cd880eb105a87d8"
I20260808 07:02:15.467228 5195 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0fe266cb41646bda51be988439109f5 in current term 2: Already voted for candidate 363cd457a64d403a8cd880eb105a87d8 in this term.
I20260808 07:02:15.467506 6027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.467292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33894)
0808 07:02:15.467421 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.467481 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260808 07:02:15.467603 6031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.467500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:33896)
0808 07:02:15.467552 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.467580 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 07:02:15.467592 4860 leader_election.cc:334] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:15.467638 4860 leader_election.cc:302] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0fe266cb41646bda51be988439109f5; no voters: 363cd457a64d403a8cd880eb105a87d8, 677b77c85e974c5994f5637502175827
W20260808 07:02:15.467665 5162 leader_election.cc:334] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:15.467725 5162 leader_election.cc:302] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363cd457a64d403a8cd880eb105a87d8; no voters: 677b77c85e974c5994f5637502175827, b0fe266cb41646bda51be988439109f5
I20260808 07:02:15.467736 6024 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 07:02:15.467797 6026 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 07:02:15.957424 6040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.957175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:39077)
0808 07:02:15.957330 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.957377 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260808 07:02:15.958143 6041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.957916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:37377)
0808 07:02:15.958048 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.958095 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260808 07:02:15.959255 6042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:15.959098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:49249)
0808 07:02:15.959198 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:15.959223 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":56,"threads_started":1}
I20260808 07:02:16.958051 6045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:16.957835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:55409)
0808 07:02:16.957966 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:16.958005 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
I20260808 07:02:16.958995 6046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:16.958743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:37795)
0808 07:02:16.958904 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:16.958947 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":77,"threads_started":1}
I20260808 07:02:16.959755 6048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:16.959593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:35605)
0808 07:02:16.959689 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:16.959722 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":48,"threads_started":1}
I20260808 07:02:17.400323 6050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:17.400427 6050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:17.400578 6050 leader_election.cc:288] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 677b77c85e974c5994f5637502175827 (127.26.23.190:39323), b0fe266cb41646bda51be988439109f5 (127.26.23.189:38633)
I20260808 07:02:17.400820 4896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "363cd457a64d403a8cd880eb105a87d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b0fe266cb41646bda51be988439109f5" is_pre_election: true
I20260808 07:02:17.400946 4896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363cd457a64d403a8cd880eb105a87d8 in term 2.
I20260808 07:02:17.400951 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.400745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:34186)
0808 07:02:17.400860 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.400908 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260808 07:02:17.401101 5160 leader_election.cc:302] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363cd457a64d403a8cd880eb105a87d8, b0fe266cb41646bda51be988439109f5; no voters:
I20260808 07:02:17.401232 6050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 07:02:17.401289 6050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:17.401311 6050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:02:17.401353 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.401255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:34190)
0808 07:02:17.401293 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.401327 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260808 07:02:17.401439 5162 leader_election.cc:334] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:17.402094 6050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:17.402235 6050 leader_election.cc:288] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 3 election: Requested vote from peers 677b77c85e974c5994f5637502175827 (127.26.23.190:39323), b0fe266cb41646bda51be988439109f5 (127.26.23.189:38633)
I20260808 07:02:17.402391 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.402299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:34206)
0808 07:02:17.402334 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.402362 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 07:02:17.402540 4896 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "363cd457a64d403a8cd880eb105a87d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b0fe266cb41646bda51be988439109f5"
I20260808 07:02:17.402684 4896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:02:17.402716 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.402625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:34212)
0808 07:02:17.402669 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.402695 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:02:17.402809 5162 leader_election.cc:334] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
I20260808 07:02:17.403349 4896 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363cd457a64d403a8cd880eb105a87d8 in term 3.
I20260808 07:02:17.403538 5160 leader_election.cc:302] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363cd457a64d403a8cd880eb105a87d8, b0fe266cb41646bda51be988439109f5; no voters: 677b77c85e974c5994f5637502175827
I20260808 07:02:17.403649 6050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:02:17.403785 6050 raft_consensus.cc:686] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [term 3 LEADER]: Becoming Leader. State: Replica: 363cd457a64d403a8cd880eb105a87d8, State: Running, Role: LEADER
I20260808 07:02:17.403856 6050 consensus_queue.cc:237] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } }
I20260808 07:02:17.404210 6054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 363cd457a64d403a8cd880eb105a87d8. Latest consensus state: current_term: 3 leader_uuid: "363cd457a64d403a8cd880eb105a87d8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:17.404315 6054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:17.404495 6059 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:17.404891 6059 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:17.404956 6059 catalog_manager.cc:1259] Loaded cluster ID: 7e1423a21eee408db0b85254b6cfcd64
I20260808 07:02:17.404986 6059 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:17.405161 6059 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:17.405232 6059 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Loaded TSK: 0
I20260808 07:02:17.405380 6059 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:02:17.477217 5182 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:17.478966 5182 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:17.480055 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.479938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:34224)
0808 07:02:17.479993 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.480027 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:02:17.480095 4896 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [term 3 FOLLOWER]: Refusing update from remote peer 363cd457a64d403a8cd880eb105a87d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 07:02:17.480392 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.480314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.0.0.1:34232)
0808 07:02:17.480343 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.480370 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 07:02:17.480343 6054 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 07:02:17.480465 5162 consensus_peers.cc:487] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 -> Peer 677b77c85e974c5994f5637502175827 (127.26.23.190:39323): Couldn't send request to peer 677b77c85e974c5994f5637502175827. Status: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 07:02:17.480966 6061 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 363cd457a64d403a8cd880eb105a87d8. Latest consensus state: current_term: 3 leader_uuid: "363cd457a64d403a8cd880eb105a87d8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:17.481105 6061 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:02:17.481467 6050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "363cd457a64d403a8cd880eb105a87d8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:17.481567 6050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:17.481648 6062 mvcc.cc:205] Tried to move back new op lower bound from 7316162713516277760 to 7316162713206767616. Current Snapshot: MvccSnapshot[applied={T|T < 7316162713516277760 or (T in {7316162713516277760})}]
I20260808 07:02:17.481812 6061 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "363cd457a64d403a8cd880eb105a87d8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "677b77c85e974c5994f5637502175827" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39323 } } peers { permanent_uuid: "b0fe266cb41646bda51be988439109f5" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 38633 } attrs { promote: false } } peers { permanent_uuid: "363cd457a64d403a8cd880eb105a87d8" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 34409 } attrs { promote: false } } }
I20260808 07:02:17.481885 6061 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0fe266cb41646bda51be988439109f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:02:17.486387 6072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.483403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:33641 (local address 127.0.0.1:60502)
0808 07:02:17.483558 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.483578 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:17.483633 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:17.483824 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:17.483825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:17.483827 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:17.483878 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.483880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.484821 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.484822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.485573 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.485575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.486190 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.486191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.486244 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.486248 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:17.486295 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:02:17.486333 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260808 07:02:17.486430 6075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.483464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60502 (local address 127.26.23.131:33641)
0808 07:02:17.483556 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:17.483558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:17.483619 (+ 61us) server_negotiation.cc:407] Connection header received
0808 07:02:17.483703 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:17.483704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:17.483716 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:17.483754 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:17.483952 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.484732 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.485656 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.486089 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.486180 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.486194 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:17.486317 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 07:02:17.486357 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71,"thread_start_us":44,"threads_started":1}
I20260808 07:02:17.486629 5798 tablet_service.cc:1467] Processing CreateTablet for tablet 9df6f3a1c5c244f7b3510fba9fb04d91 (DEFAULT_TABLE table=test-table [id=4b21ed8b93b045b68ae2f04e70cc2e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:17.486774 5798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9df6f3a1c5c244f7b3510fba9fb04d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:17.486912 6051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.483364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44227 (local address 127.0.0.1:46880)
0808 07:02:17.483450 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.483461 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:17.483510 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:17.483850 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:17.483851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:17.483852 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:17.483878 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.483880 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.484786 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.484787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.485958 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.485960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.486712 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.486714 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.486782 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.486786 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:17.486817 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 07:02:17.486855 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":61}
I20260808 07:02:17.487169 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.483586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46880 (local address 127.26.23.129:44227)
0808 07:02:17.483723 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:17.483724 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:17.483734 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:17.483759 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:17.483760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:17.483770 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:17.483934 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:17.483972 (+ 38us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.484720 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.486042 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.486614 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.487013 (+ 399us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.487039 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:17.487059 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 07:02:17.487106 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260808 07:02:17.487448 5350 tablet_service.cc:1467] Processing CreateTablet for tablet 9df6f3a1c5c244f7b3510fba9fb04d91 (DEFAULT_TABLE table=test-table [id=4b21ed8b93b045b68ae2f04e70cc2e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:17.487532 6074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.483418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:45935 (local address 127.0.0.1:45114)
0808 07:02:17.483709 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.483720 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:17.483765 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:17.484038 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:17.484039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:17.484041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:17.484087 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.484088 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.484736 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.484737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.486220 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.486222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.487193 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.487194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.487256 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.487259 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:17.487417 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 07:02:17.487459 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":62,"thread_start_us":79,"threads_started":1}
I20260808 07:02:17.487576 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.483664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45114 (local address 127.26.23.130:45935)
0808 07:02:17.483881 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:17.483883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:17.483890 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:17.483915 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:17.483916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:17.483926 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:17.483979 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:17.484150 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.484666 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.486545 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.487104 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.487160 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.487170 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:17.487450 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 07:02:17.487499 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":71,"threads_started":1}
I20260808 07:02:17.487592 5350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9df6f3a1c5c244f7b3510fba9fb04d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:17.488154 6085 tablet_bootstrap.cc:492] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Bootstrap starting.
I20260808 07:02:17.488454 6085 tablet_bootstrap.cc:654] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:17.488847 6089 tablet_bootstrap.cc:492] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Bootstrap starting.
I20260808 07:02:17.488986 6085 tablet_bootstrap.cc:492] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: No bootstrap required, opened a new log
I20260808 07:02:17.489046 6085 ts_tablet_manager.cc:1397] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:17.489074 5560 tablet_service.cc:1467] Processing CreateTablet for tablet 9df6f3a1c5c244f7b3510fba9fb04d91 (DEFAULT_TABLE table=test-table [id=4b21ed8b93b045b68ae2f04e70cc2e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:17.489171 6085 raft_consensus.cc:348] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.489223 6089 tablet_bootstrap.cc:654] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:17.489231 6085 raft_consensus.cc:374] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:17.489249 6085 raft_consensus.cc:729] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a56aa865e064b658acca483187d8ffa, State: Initialized, Role: FOLLOWER
I20260808 07:02:17.489291 6085 consensus_queue.cc:260] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.489331 5560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9df6f3a1c5c244f7b3510fba9fb04d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:17.489423 6085 ts_tablet_manager.cc:1428] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:17.490609 6093 tablet_bootstrap.cc:492] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Bootstrap starting.
I20260808 07:02:17.490748 5909 heartbeater.cc:503] Master 127.26.23.188:34409 was elected leader, sending a full tablet report...
I20260808 07:02:17.490764 6092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.490347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:58645)
0808 07:02:17.490475 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.490510 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260808 07:02:17.491012 6093 tablet_bootstrap.cc:654] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:17.491212 6089 tablet_bootstrap.cc:492] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00: No bootstrap required, opened a new log
I20260808 07:02:17.491257 6089 ts_tablet_manager.cc:1397] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:17.491355 6089 raft_consensus.cc:348] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.491425 6089 raft_consensus.cc:374] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:17.491451 6089 raft_consensus.cc:729] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8ac9db9c45546bdb7c8d7b7b7b88e00, State: Initialized, Role: FOLLOWER
I20260808 07:02:17.491498 6089 consensus_queue.cc:260] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.491618 6093 tablet_bootstrap.cc:492] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: No bootstrap required, opened a new log
I20260808 07:02:17.491667 6093 ts_tablet_manager.cc:1397] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:17.491634 6089 ts_tablet_manager.cc:1428] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:17.491987 6097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.491800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:57971)
0808 07:02:17.491919 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.491957 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260808 07:02:17.492164 6093 raft_consensus.cc:348] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.492249 6093 raft_consensus.cc:374] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:17.492270 6093 raft_consensus.cc:729] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aee349deaffd4bda83e8a2e44c385793, State: Initialized, Role: FOLLOWER
I20260808 07:02:17.492290 5455 heartbeater.cc:503] Master 127.26.23.188:34409 was elected leader, sending a full tablet report...
I20260808 07:02:17.492349 6093 consensus_queue.cc:260] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.492413 6097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.492211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:37015)
0808 07:02:17.492362 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.492391 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 07:02:17.492539 6093 ts_tablet_manager.cc:1428] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:02:17.492915 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.492718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:38375)
0808 07:02:17.492835 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.492873 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":78,"threads_started":1}
I20260808 07:02:17.493080 5679 heartbeater.cc:503] Master 127.26.23.188:34409 was elected leader, sending a full tablet report...
I20260808 07:02:17.493296 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.493149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:53681)
0808 07:02:17.493181 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.493209 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 07:02:17.624827 6099 raft_consensus.cc:482] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:17.624928 6099 raft_consensus.cc:504] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.625262 6099 leader_election.cc:288] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227), 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:17.628502 6075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.625509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:35883 (local address 127.26.23.131:33641)
0808 07:02:17.625580 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:17.625582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:17.625847 (+ 265us) server_negotiation.cc:407] Connection header received
0808 07:02:17.625935 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:17.625936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:17.625947 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:17.625989 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:17.626120 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.626830 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.627832 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.628196 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.628256 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.628266 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:17.628393 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 07:02:17.628428 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:02:17.628500 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.625511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:48539 (local address 127.26.23.129:44227)
0808 07:02:17.625636 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:17.625638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:17.625834 (+ 196us) server_negotiation.cc:407] Connection header received
0808 07:02:17.625892 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:17.625893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:17.625922 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:17.625967 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:17.626118 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.626799 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.627790 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.628191 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.628254 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.628266 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:17.628396 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 07:02:17.628431 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:02:17.628520 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.625441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44227 (local address 127.26.23.130:48539)
0808 07:02:17.625754 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.625765 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:17.625830 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:17.625997 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:17.625998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:17.626005 (+ 7us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:17.626062 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.626063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.626866 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.626867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.627707 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.627709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.628267 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.628269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.628334 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.628337 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:17.628382 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:17.628427 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260808 07:02:17.628765 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6f3a1c5c244f7b3510fba9fb04d91" candidate_uuid: "aee349deaffd4bda83e8a2e44c385793" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" is_pre_election: true
I20260808 07:02:17.628921 5380 raft_consensus.cc:2454] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee349deaffd4bda83e8a2e44c385793 in term 0.
I20260808 07:02:17.628530 6101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.625442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:33641 (local address 127.26.23.130:35883)
0808 07:02:17.625777 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.625785 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:17.625864 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:17.625995 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:17.625996 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:17.625998 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:17.626059 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.626061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.626902 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.626903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.627704 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:17.627707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.628264 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.628265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:17.628337 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.628339 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:17.628382 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 07:02:17.628429 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":163,"thread_start_us":110,"threads_started":1}
I20260808 07:02:17.629130 5490 leader_election.cc:302] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee349deaffd4bda83e8a2e44c385793, b8ac9db9c45546bdb7c8d7b7b7b88e00; no voters:
I20260808 07:02:17.629280 6099 raft_consensus.cc:2781] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:17.629320 6099 raft_consensus.cc:482] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:17.629334 6099 raft_consensus.cc:3037] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:17.629295 5835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6f3a1c5c244f7b3510fba9fb04d91" candidate_uuid: "aee349deaffd4bda83e8a2e44c385793" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a56aa865e064b658acca483187d8ffa" is_pre_election: true
I20260808 07:02:17.629393 5835 raft_consensus.cc:2454] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aee349deaffd4bda83e8a2e44c385793 in term 0.
I20260808 07:02:17.630034 6099 raft_consensus.cc:504] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.630189 6099 leader_election.cc:288] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [CANDIDATE]: Term 1 election: Requested vote from peers b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227), 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641)
I20260808 07:02:17.630330 5380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6f3a1c5c244f7b3510fba9fb04d91" candidate_uuid: "aee349deaffd4bda83e8a2e44c385793" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00"
I20260808 07:02:17.630395 5380 raft_consensus.cc:3037] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:17.631071 5380 raft_consensus.cc:2454] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee349deaffd4bda83e8a2e44c385793 in term 1.
I20260808 07:02:17.631175 5835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9df6f3a1c5c244f7b3510fba9fb04d91" candidate_uuid: "aee349deaffd4bda83e8a2e44c385793" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a56aa865e064b658acca483187d8ffa"
I20260808 07:02:17.631258 5835 raft_consensus.cc:3037] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:17.631244 5490 leader_election.cc:302] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aee349deaffd4bda83e8a2e44c385793, b8ac9db9c45546bdb7c8d7b7b7b88e00; no voters:
I20260808 07:02:17.631331 6099 raft_consensus.cc:2781] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:17.631505 6099 raft_consensus.cc:686] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 1 LEADER]: Becoming Leader. State: Replica: aee349deaffd4bda83e8a2e44c385793, State: Running, Role: LEADER
I20260808 07:02:17.631645 6099 consensus_queue.cc:237] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } }
I20260808 07:02:17.631839 6101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.631742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:42535)
0808 07:02:17.631781 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.631815 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 07:02:17.632015 5835 raft_consensus.cc:2454] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aee349deaffd4bda83e8a2e44c385793 in term 1.
I20260808 07:02:17.632489 5182 catalog_manager.cc:5495] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 reported cstate change: term changed from 0 to 1, leader changed from <none> to aee349deaffd4bda83e8a2e44c385793 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "aee349deaffd4bda83e8a2e44c385793" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aee349deaffd4bda83e8a2e44c385793" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45935 } health_report { overall_health: HEALTHY } } }
I20260808 07:02:17.666469 6084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.664301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45124 (local address 127.26.23.130:45935)
0808 07:02:17.664354 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:17.664355 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:17.664364 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:17.664396 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:17.664397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:17.664414 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:17.664469 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:17.664588 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.665041 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.665792 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:17.665968 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:17.666008 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:17.666223 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:17.666319 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:17.666373 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:17.666398 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 07:02:17.666416 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:17.667542 5835 raft_consensus.cc:1261] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Refusing update from remote peer aee349deaffd4bda83e8a2e44c385793: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:17.667817 5380 raft_consensus.cc:1261] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00 [term 1 FOLLOWER]: Refusing update from remote peer aee349deaffd4bda83e8a2e44c385793: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:17.668085 6103 consensus_queue.cc:1035] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a56aa865e064b658acca483187d8ffa" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 33641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:17.668227 6099 consensus_queue.cc:1035] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8ac9db9c45546bdb7c8d7b7b7b88e00" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:17.669157 6097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.668951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:34281)
0808 07:02:17.669076 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.669123 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260808 07:02:17.669278 6092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.669126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:47651)
0808 07:02:17.669218 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.669251 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 07:02:17.670661 6101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.670541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.130:58571)
0808 07:02:17.670597 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.670632 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:02:17.670727 6108 mvcc.cc:205] Tried to move back new op lower bound from 7316162714284408832 to 7316162714140585984. Current Snapshot: MvccSnapshot[applied={T|T < 7316162714284408832 or (T in {7316162714284408832})}]
I20260808 07:02:17.671096 6097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.670925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.129:57679)
0808 07:02:17.671038 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.671068 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 07:02:17.671288 6092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:17.670711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39323 (local address 127.26.23.131:55433)
0808 07:02:17.671228 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.671259 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499}
I20260808 07:02:17.672374 6110 mvcc.cc:205] Tried to move back new op lower bound from 7316162714284408832 to 7316162714140585984. Current Snapshot: MvccSnapshot[applied={T|T < 7316162714284408832}]
I20260808 07:02:17.672634 5182 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:17.672724 5182 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:17.673868 5182 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 363cd457a64d403a8cd880eb105a87d8: Sending DeleteTablet for 3 replicas of tablet 9df6f3a1c5c244f7b3510fba9fb04d91
I20260808 07:02:17.674180 5560 tablet_service.cc:1514] Processing DeleteTablet for tablet 9df6f3a1c5c244f7b3510fba9fb04d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:17 UTC) from {username='oryx', principal='oryx/127.26.23.188@KRBTEST.COM'} at 127.0.0.1:45114
I20260808 07:02:17.674347 5350 tablet_service.cc:1514] Processing DeleteTablet for tablet 9df6f3a1c5c244f7b3510fba9fb04d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:17 UTC) from {username='oryx', principal='oryx/127.26.23.188@KRBTEST.COM'} at 127.0.0.1:46880
I20260808 07:02:17.674346 5798 tablet_service.cc:1514] Processing DeleteTablet for tablet 9df6f3a1c5c244f7b3510fba9fb04d91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:17 UTC) from {username='oryx', principal='oryx/127.26.23.188@KRBTEST.COM'} at 127.0.0.1:60502
I20260808 07:02:17.674371 6121 tablet_replica.cc:330] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: stopping tablet replica
I20260808 07:02:17.674417 6121 raft_consensus.cc:2229] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:17.674492 6121 raft_consensus.cc:2258] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:17.674763 6123 tablet_replica.cc:330] T 9df6f3a1c5c244f7b3510fba9fb04d91 P b8ac9db9c45546bdb7c8d7b7b7b88e00: stopping tablet replica
I20260808 07:02:17.674783 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 5253
I20260808 07:02:17.689810 6121 ts_tablet_manager.cc:1905] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:17.690272 6127 tablet_replica.cc:330] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: stopping tablet replica
I20260808 07:02:17.690554 6127 raft_consensus.cc:2229] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:17.690712 6127 raft_consensus.cc:2258] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:17.691088 6127 ts_tablet_manager.cc:1905] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:17.691568 6121 ts_tablet_manager.cc:1918] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:17.691702 6121 log.cc:1196] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/9df6f3a1c5c244f7b3510fba9fb04d91
I20260808 07:02:17.692003 6121 ts_tablet_manager.cc:1939] T 9df6f3a1c5c244f7b3510fba9fb04d91 P aee349deaffd4bda83e8a2e44c385793: Deleting consensus metadata
I20260808 07:02:17.692440 5163 catalog_manager.cc:4841] TS aee349deaffd4bda83e8a2e44c385793 (127.26.23.130:45935): tablet 9df6f3a1c5c244f7b3510fba9fb04d91 (table test-table [id=4b21ed8b93b045b68ae2f04e70cc2e7d]) successfully deleted
I20260808 07:02:17.692684 6127 ts_tablet_manager.cc:1918] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:17.692747 6127 log.cc:1196] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/9df6f3a1c5c244f7b3510fba9fb04d91
I20260808 07:02:17.692945 6127 ts_tablet_manager.cc:1939] T 9df6f3a1c5c244f7b3510fba9fb04d91 P 3a56aa865e064b658acca483187d8ffa: Deleting consensus metadata
I20260808 07:02:17.694238 5160 catalog_manager.cc:4841] TS 3a56aa865e064b658acca483187d8ffa (127.26.23.131:33641): tablet 9df6f3a1c5c244f7b3510fba9fb04d91 (table test-table [id=4b21ed8b93b045b68ae2f04e70cc2e7d]) successfully deleted
W20260808 07:02:17.697049 6074 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:17.696917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44227 (local address 127.0.0.1:46882)
0808 07:02:17.696965 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:17.696989 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:44227: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:02:17.697271 5162 catalog_manager.cc:4584] TS b8ac9db9c45546bdb7c8d7b7b7b88e00 (127.26.23.129:44227): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9df6f3a1c5c244f7b3510fba9fb04d91: Network error: Client connection negotiation failed: client connection to 127.26.23.129:44227: connect: Connection reset by peer (error 104)
I20260808 07:02:17.697299 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 5464
I20260808 07:02:17.705215 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 5689
I20260808 07:02:17.714979 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 4670
I20260808 07:02:17.725719 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 4970
2026-08-08T07:02:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7015 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:17 dist-test-slave-zj8q krb5kdc[6132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:17 dist-test-slave-zj8q krb5kdc[6132](info): set up 2 sockets
Aug 08 07:02:17 dist-test-slave-zj8q krb5kdc[6132](info): commencing operation
krb5kdc: starting...
W20260808 07:02:18.873615 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:18 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:18Z Disabled control of system clock
WARNING: no policy specified for oryx/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab.
Entry for principal oryx/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab.
I20260808 07:02:18.984409 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33291
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab
--principal=oryx/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:33291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:19.065181 6154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:19.065392 6154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:19.065423 6154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:19.066649 6154 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:19.066694 6154 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 07:02:19.066713 6154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:19.066728 6154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:19.066744 6154 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:19.066768 6154 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:19.068341 6154 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:33291
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.190.keytab
--principal=oryx/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:19.068600 6154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:19.068809 6154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:19.073454 6169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:19.073436 6159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:19.073523 6161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:19.073601 6154 server_base.cc:1034] running on GCE node
I20260808 07:02:19.073983 6154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:19.074298 6154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:19.075434 6154 hybrid_clock.cc:648] HybridClock initialized: now 1786172539075419 us; error 33 us; skew 500 ppm
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:19.078006 6154 init.cc:377] Logged in from keytab as oryx/127.26.23.190@KRBTEST.COM (short username oryx)
I20260808 07:02:19.078496 6154 webserver.cc:460] Webserver started at http://127.26.23.190:38865/ using document root <none> and password file <none>
I20260808 07:02:19.078727 6154 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:19.078778 6154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:19.078904 6154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:19.079928 6154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "3e8b6f58463b4a51bab5c255016883bf"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "ccb27024b0a6809d426fc2c0344460b5"
server_key_iv: "f514e952f149a2e1cfa5f3f4bc58e409"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.080268 6154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "3e8b6f58463b4a51bab5c255016883bf"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "ccb27024b0a6809d426fc2c0344460b5"
server_key_iv: "f514e952f149a2e1cfa5f3f4bc58e409"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.081513 6154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:19.082254 6181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.082417 6154 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:19.082506 6154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "3e8b6f58463b4a51bab5c255016883bf"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "ccb27024b0a6809d426fc2c0344460b5"
server_key_iv: "f514e952f149a2e1cfa5f3f4bc58e409"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.082600 6154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:19.102356 6154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:19.104192 6154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:19.104326 6154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:19.108992 6154 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:33291
I20260808 07:02:19.109086 6275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:33291 every 8 connection(s)
I20260808 07:02:19.109370 6154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:19.110030 6277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.112330 6277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Bootstrap starting.
I20260808 07:02:19.112926 6277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.113189 6277 log.cc:824] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:19.113871 6277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: No bootstrap required, opened a new log
I20260808 07:02:19.115931 6277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8b6f58463b4a51bab5c255016883bf" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33291 } }
I20260808 07:02:19.116068 6277 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.116101 6277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8b6f58463b4a51bab5c255016883bf, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.116230 6277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8b6f58463b4a51bab5c255016883bf" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33291 } }
I20260808 07:02:19.116300 6277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:19.116333 6277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:19.116379 6277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.116873 6277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8b6f58463b4a51bab5c255016883bf" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33291 } }
I20260808 07:02:19.116966 6277 leader_election.cc:302] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8b6f58463b4a51bab5c255016883bf; no voters:
I20260808 07:02:19.117120 6277 leader_election.cc:288] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:19.117170 6284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:19.117331 6284 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [term 1 LEADER]: Becoming Leader. State: Replica: 3e8b6f58463b4a51bab5c255016883bf, State: Running, Role: LEADER
I20260808 07:02:19.117359 6277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:19.117421 6284 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8b6f58463b4a51bab5c255016883bf" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33291 } }
I20260808 07:02:19.117762 6286 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e8b6f58463b4a51bab5c255016883bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8b6f58463b4a51bab5c255016883bf" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33291 } } }
I20260808 07:02:19.117769 6289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e8b6f58463b4a51bab5c255016883bf. Latest consensus state: current_term: 1 leader_uuid: "3e8b6f58463b4a51bab5c255016883bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8b6f58463b4a51bab5c255016883bf" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33291 } } }
I20260808 07:02:19.117939 6289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:19.118359 6286 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:19.118407 6299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:19.118916 6299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:19.119210 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 6154
I20260808 07:02:19.119302 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:19.119505 26718 external_mini_cluster.cc:1428] Setting key e6985a0e9a8caab76845e8ea1e6e4a9f
I20260808 07:02:19.120534 6299 catalog_manager.cc:1347] Generated new cluster ID: 5b5cb75a8f8146269f8ae3bdac3fdb71
I20260808 07:02:19.120589 6299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172538, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:19.130887 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.119925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38338 (local address 127.26.23.190:33291)
0808 07:02:19.120122 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.120132 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.120169 (+ 37us) server_negotiation.cc:407] Connection header received
0808 07:02:19.120347 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.120354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.120410 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.120534 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.121346 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.122793 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.123801 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.124479 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.124592 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.127480 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.127484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.127484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.127496 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.129299 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.129690 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.129693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.129693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.129788 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.129966 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.129966 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.129967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.130280 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.130415 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.130528 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.130659 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":71,"threads_started":1}
I20260808 07:02:19.136649 6299 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:19.137326 6299 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:19.146051 6299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Generated new TSK 0
I20260808 07:02:19.146236 6299 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab.
Entry for principal oryx/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab.
I20260808 07:02:19.173071 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33291
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:19.254009 6317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:19.254243 6317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:19.254287 6317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:19.255431 6317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:19.255472 6317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:19.255501 6317 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:02:19.255533 6317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:19.257045 6317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:33291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:19.257268 6317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:19.257473 6317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:19.262338 6330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:19.262328 6331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:19.262360 6317 server_base.cc:1034] running on GCE node
W20260808 07:02:19.262331 6334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:19.262712 6317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:19.262955 6317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:19.264091 6317 hybrid_clock.cc:648] HybridClock initialized: now 1786172539264080 us; error 25 us; skew 500 ppm
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:19.266499 6317 init.cc:377] Logged in from keytab as oryx/127.26.23.129@KRBTEST.COM (short username oryx)
I20260808 07:02:19.266894 6317 webserver.cc:460] Webserver started at http://127.26.23.129:42745/ using document root <none> and password file <none>
I20260808 07:02:19.267104 6317 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:19.267160 6317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:19.267300 6317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:19.268321 6317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "52c238de5e9e58bb8c69e93f164a54e9"
server_key_iv: "8674b7ef7f1abd5380ed6afa3f9f9b4d"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.268646 6317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "52c238de5e9e58bb8c69e93f164a54e9"
server_key_iv: "8674b7ef7f1abd5380ed6afa3f9f9b4d"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.269896 6317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:19.270695 6348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.270849 6317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.270936 6317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "52c238de5e9e58bb8c69e93f164a54e9"
server_key_iv: "8674b7ef7f1abd5380ed6afa3f9f9b4d"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.271003 6317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:19.281975 6317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:19.283690 6317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:19.283818 6317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:19.284298 6317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:19.284336 6317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.284364 6317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:19.284380 6317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:19.291615 6317 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:36743
I20260808 07:02:19.291676 6543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:36743 every 8 connection(s)
I20260808 07:02:19.291992 6317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:02:19.293448 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.284676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:41977 (local address 127.26.23.190:33291)
0808 07:02:19.284745 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.284747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.284929 (+ 182us) server_negotiation.cc:407] Connection header received
0808 07:02:19.285555 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.285556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.285568 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.285606 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.286492 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.287059 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.288524 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.288776 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.288841 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.290915 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.290917 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.290917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.290930 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.292472 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.292797 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.292798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.292799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.292852 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.293008 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.293008 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.293009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.293099 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.293144 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.293321 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.293385 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 07:02:19.293606 6368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.284636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.26.23.129:41977)
0808 07:02:19.284797 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.284845 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.285433 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.285709 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.285722 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.286093 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.286394 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.286402 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.287134 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.287135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.288436 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.288439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.288871 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.288872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.289002 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.289447 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.289456 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.290834 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.292528 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.292532 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.292534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.292744 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.292893 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.292893 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.292894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.292975 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.293134 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.293137 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.293239 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.293310 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.293421 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260808 07:02:19.294072 6546 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33291
I20260808 07:02:19.294175 6546 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:19.294363 6546 heartbeater.cc:511] Master 127.26.23.190:33291 requested a full tablet report, sending...
I20260808 07:02:19.294922 6206 ts_manager.cc:194] Registered new tserver with Master: ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743)
I20260808 07:02:19.295780 6206 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:41977
I20260808 07:02:19.297796 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 6317
I20260808 07:02:19.297896 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:19.298172 26718 external_mini_cluster.cc:1428] Setting key 78e812f474b47291a643c3153c607ec3
I20260808 07:02:19.300321 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.295133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:48735 (local address 127.26.23.190:33291)
0808 07:02:19.295174 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.295176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.295315 (+ 139us) server_negotiation.cc:407] Connection header received
0808 07:02:19.295371 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.295372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.295380 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.295421 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.295735 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.296341 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.297060 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.297241 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.297282 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.298139 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.298140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.298140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.298146 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.299351 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.299712 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.299713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.299713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.299760 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.299925 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.299925 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.299926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.300008 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.300048 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.300208 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.300264 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":20}
I20260808 07:02:19.300441 6554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.295085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.26.23.129:48735)
0808 07:02:19.295241 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.295252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.295319 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.295426 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.295426 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.295608 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.295682 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.295683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.296431 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.296432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.296993 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.296995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.297289 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.297289 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.297337 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.297662 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.297667 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.298060 (+ 393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.299427 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.299428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.299428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.299648 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.299812 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.299812 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.299813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.299875 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.300059 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.300060 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.300106 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.300184 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.300281 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for oryx/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab.
Entry for principal oryx/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab.
I20260808 07:02:19.321956 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33291
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:19.402899 6558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:19.403090 6558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:19.403121 6558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:19.404240 6558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:19.404279 6558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:19.404306 6558 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:02:19.404330 6558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:19.405844 6558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:33291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:19.406087 6558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:19.406299 6558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:19.411041 6573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:19.411051 6567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:19.411118 6571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:19.411155 6558 server_base.cc:1034] running on GCE node
I20260808 07:02:19.411490 6558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:19.411713 6558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:19.412848 6558 hybrid_clock.cc:648] HybridClock initialized: now 1786172539412832 us; error 34 us; skew 500 ppm
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:19.415218 6558 init.cc:377] Logged in from keytab as oryx/127.26.23.130@KRBTEST.COM (short username oryx)
I20260808 07:02:19.415616 6558 webserver.cc:460] Webserver started at http://127.26.23.130:43787/ using document root <none> and password file <none>
I20260808 07:02:19.415875 6558 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:19.415925 6558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:19.416049 6558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:19.417052 6558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "2160338f0eb24e9f9a966a8940d8550f"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "8c36cbf9a342d401a0fd0313f9708473"
server_key_iv: "67c519a34e10a00b5302326936338af7"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.417376 6558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "2160338f0eb24e9f9a966a8940d8550f"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "8c36cbf9a342d401a0fd0313f9708473"
server_key_iv: "67c519a34e10a00b5302326936338af7"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.418763 6558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:19.419461 6581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.419610 6558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:19.419723 6558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "2160338f0eb24e9f9a966a8940d8550f"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "8c36cbf9a342d401a0fd0313f9708473"
server_key_iv: "67c519a34e10a00b5302326936338af7"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.419782 6558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:19.435235 6558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:19.437233 6558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:19.437363 6558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:19.437825 6558 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:19.437868 6558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.437896 6558 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:19.437913 6558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:19.444401 6558 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:44081
I20260808 07:02:19.444473 6757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:44081 every 8 connection(s)
I20260808 07:02:19.444799 6558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:19.446282 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 6558
I20260808 07:02:19.446374 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:19.446554 26718 external_mini_cluster.cc:1428] Setting key a61ce1d38968fe2b8ad72939d35aae59
I20260808 07:02:19.447099 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.438279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:55989 (local address 127.26.23.190:33291)
0808 07:02:19.438348 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.438351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.438528 (+ 177us) server_negotiation.cc:407] Connection header received
0808 07:02:19.438994 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.438996 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.439009 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.439082 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.439825 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.440585 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.442020 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.442360 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.442434 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.444414 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.444415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.444416 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.444423 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.445788 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.446139 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.446140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.446141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.446219 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.446451 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.446452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.446453 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.446569 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.446626 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.446926 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.447009 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:02:19.447245 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.438264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.26.23.130:55989)
0808 07:02:19.438407 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.438446 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.438908 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.439164 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.439167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.439466 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.439727 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.439733 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.440683 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.440684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.441915 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.441919 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.442440 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.442441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.442563 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.442988 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.442996 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.444321 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.445858 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.445864 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.445866 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.446070 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.446274 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.446275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.446275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.446398 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.446631 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.446638 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.446788 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.446885 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.447032 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260808 07:02:19.447679 6758 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33291
I20260808 07:02:19.447764 6758 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:19.447933 6758 heartbeater.cc:511] Master 127.26.23.190:33291 requested a full tablet report, sending...
I20260808 07:02:19.448259 6205 ts_manager.cc:194] Registered new tserver with Master: 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081)
I20260808 07:02:19.448591 6205 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:55989
I20260808 07:02:19.455541 6774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.450020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.26.23.130:38687)
0808 07:02:19.450218 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.450227 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.450279 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.450388 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.450388 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.450530 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.450592 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.450593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.451436 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.451437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.451993 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.451995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.452429 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.452429 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.452474 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.452828 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.452834 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.453111 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.454613 (+ 1502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.454613 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.454614 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.454781 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.454972 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.454973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.454973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.455020 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.455323 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.455324 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.455364 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.455409 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.455476 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":145,"threads_started":1}
I20260808 07:02:19.455593 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.450079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:38687 (local address 127.26.23.190:33291)
0808 07:02:19.450118 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.450120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.450283 (+ 163us) server_negotiation.cc:407] Connection header received
0808 07:02:19.450311 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.450312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.450322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.450384 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.450660 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.451330 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.452083 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.452363 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.452433 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.453193 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.453194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.453194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.453201 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.454531 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.454850 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.454851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.454852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.454910 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.455075 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.455076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.455076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.455265 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.455336 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.455436 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.455510 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for oryx/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab.
Entry for principal oryx/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab.
I20260808 07:02:19.471312 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33291
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:19.551259 6776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:19.551446 6776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:19.551468 6776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:19.552589 6776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:19.552627 6776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:19.552645 6776 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 07:02:19.552675 6776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:19.554116 6776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.26.23.190:33291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:19.554363 6776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:19.554563 6776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:19.559289 6787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:19.559350 6788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:19.559456 6776 server_base.cc:1034] running on GCE node
W20260808 07:02:19.559314 6793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:19.559790 6776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:19.560007 6776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:19.561156 6776 hybrid_clock.cc:648] HybridClock initialized: now 1786172539561140 us; error 34 us; skew 500 ppm
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:19.563593 6776 init.cc:377] Logged in from keytab as oryx/127.26.23.131@KRBTEST.COM (short username oryx)
I20260808 07:02:19.564003 6776 webserver.cc:460] Webserver started at http://127.26.23.131:45127/ using document root <none> and password file <none>
I20260808 07:02:19.564203 6776 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:19.564251 6776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:19.564375 6776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:19.565357 6776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "326242bc9bf042c4abb082abfd0bb298"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "c5fa8d81b908124c33ad6bdab747e8ed"
server_key_iv: "678e79af0407886bca621ab737e2deee"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.565708 6776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "326242bc9bf042c4abb082abfd0bb298"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "c5fa8d81b908124c33ad6bdab747e8ed"
server_key_iv: "678e79af0407886bca621ab737e2deee"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.566983 6776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:19.567646 6802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.567803 6776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:19.567889 6776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "326242bc9bf042c4abb082abfd0bb298"
format_stamp: "Formatted at 2026-08-08 07:02:19 on dist-test-slave-zj8q"
server_key: "c5fa8d81b908124c33ad6bdab747e8ed"
server_key_iv: "678e79af0407886bca621ab737e2deee"
server_key_version: "encryptionkey@0"
I20260808 07:02:19.567946 6776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:19.584959 6776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:19.587049 6776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:19.587189 6776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:19.587682 6776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:19.587721 6776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.587749 6776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:19.587775 6776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:19.594705 6776 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:46591
I20260808 07:02:19.594759 6990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:46591 every 8 connection(s)
I20260808 07:02:19.595073 6776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:19.596094 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 6776
I20260808 07:02:19.596202 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:19.596392 26718 external_mini_cluster.cc:1428] Setting key efd0a7ab93223866198741f09d6dc2c7
I20260808 07:02:19.596887 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.588087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:48013 (local address 127.26.23.190:33291)
0808 07:02:19.588161 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.588164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.588330 (+ 166us) server_negotiation.cc:407] Connection header received
0808 07:02:19.588812 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.588813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.588827 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.588893 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.589694 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.590495 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.591470 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.591759 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.591834 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.594007 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.594008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.594009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.594016 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.595586 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.595942 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.595943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.595944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.596009 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.596247 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.596248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.596248 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.596373 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.596433 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.596717 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.596801 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:19.597035 6813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.588059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.26.23.131:48013)
0808 07:02:19.588212 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.588251 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.588723 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.588978 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.588981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.589327 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.589596 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.589602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.590589 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.590590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.591402 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.591405 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.591855 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.591856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.591981 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.592420 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.592437 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.593919 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.595651 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.595654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.595656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.595860 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.596071 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.596072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.596072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.596170 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.596435 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.596441 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.596572 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.596683 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.596847 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260808 07:02:19.597434 6991 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33291
I20260808 07:02:19.597514 6991 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:19.597687 6991 heartbeater.cc:511] Master 127.26.23.190:33291 requested a full tablet report, sending...
I20260808 07:02:19.598038 6206 ts_manager.cc:194] Registered new tserver with Master: 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:19.598526 6206 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:48013
I20260808 07:02:19.602975 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.598447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:50655 (local address 127.26.23.190:33291)
0808 07:02:19.598488 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.598490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.598598 (+ 108us) server_negotiation.cc:407] Connection header received
0808 07:02:19.598664 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.598665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.598676 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.598721 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.599068 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.599518 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.600144 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.600319 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.600364 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.601020 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.601021 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.601021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.601026 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.602247 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.602493 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.602494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.602494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.602538 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.602652 (+ 114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.602653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.602653 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.602733 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.602774 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.602864 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.602919 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:02:19.602985 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.598400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.26.23.131:50655)
0808 07:02:19.598535 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.598544 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.598600 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.598730 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.598731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.598905 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.598991 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.598993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.599592 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.599593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.600071 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.600072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.600367 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.600367 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.600408 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.600711 (+ 303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.600715 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.600957 (+ 242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.602304 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.602304 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.602305 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.602443 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.602573 (+ 130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.602574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.602574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.602617 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.602772 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.602773 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.602805 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.602849 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.602920 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260808 07:02:19.608726 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:02:19.629746 6311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:19.624792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.26.23.190:33291)
0808 07:02:19.624845 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.624846 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.624870 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:02:19.624934 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.624935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.624945 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.624990 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.625523 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.626006 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.626747 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.626937 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.626990 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.629668 (+ 2678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38346: BlockingRecv error: recv got EOF from 127.0.0.1:38346 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:19.636158 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.630384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.26.23.190:33291)
0808 07:02:19.630441 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.630443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.630487 (+ 44us) server_negotiation.cc:407] Connection header received
0808 07:02:19.630557 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.630558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.630567 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.630643 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.631061 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.631525 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.632156 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.632335 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.632386 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.634199 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.634201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.634201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.634208 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.635230 (+ 1022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.635510 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.635512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.635512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.635562 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.635724 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.635725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.635725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.635826 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.635909 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.636006 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.636075 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:02:19.637411 6206 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:19.639045 6206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:19.645048 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.641201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36743 (local address 127.0.0.1:38958)
0808 07:02:19.641483 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.641492 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.641526 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.641689 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.641690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.641692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.641758 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.641760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.643033 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.643034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.644113 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.644115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.644759 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.644839 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.644854 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.644922 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.644975 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":36,"thread_start_us":46,"threads_started":1}
I20260808 07:02:19.645066 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.641315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.26.23.129:36743)
0808 07:02:19.641506 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.641511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.641523 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:02:19.641599 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.641601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.641616 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.641686 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.641839 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.642944 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644185 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.644682 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644743 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.644823 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.644940 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.644978 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":92,"threads_started":1}
I20260808 07:02:19.645272 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.641138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42904 (local address 127.26.23.131:46591)
0808 07:02:19.641539 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.641543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.641551 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:19.641581 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.641583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.641595 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.641660 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.641854 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.642654 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644024 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.644772 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644839 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.644911 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.645120 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.645162 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":76,"threads_started":1}
I20260808 07:02:19.645397 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.641126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55414 (local address 127.26.23.130:44081)
0808 07:02:19.641799 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.641803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.641813 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:19.641848 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.641849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.641864 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.641929 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.642116 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.643165 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644218 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.644926 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644985 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.645056 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.645251 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.645297 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":92,"threads_started":1}
I20260808 07:02:19.645315 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.641017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44081 (local address 127.0.0.1:55414)
0808 07:02:19.641308 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.641339 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.641395 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.642000 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.642001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.642003 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.642045 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.642047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.643234 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.643235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.644117 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.644120 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.645087 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.645088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.645157 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.645160 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.645213 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.645252 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":6,"thread_start_us":53,"threads_started":1}
I20260808 07:02:19.645454 7020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.641017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:46591 (local address 127.0.0.1:42904)
0808 07:02:19.641307 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.641342 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.641396 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.641676 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.641679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.641681 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.641743 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.641745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.642730 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.642731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.643895 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.643897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.644950 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.644951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.645023 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.645027 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.645361 (+ 334us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.645401 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":55,"threads_started":1}
I20260808 07:02:19.646279 6655 tablet_service.cc:1467] Processing CreateTablet for tablet 19c47a9e7c754e949cc9fee93f413c8a (DEFAULT_TABLE table=test-table [id=6eb973629390455b86fb45a77a16df28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:19.646281 6422 tablet_service.cc:1467] Processing CreateTablet for tablet 19c47a9e7c754e949cc9fee93f413c8a (DEFAULT_TABLE table=test-table [id=6eb973629390455b86fb45a77a16df28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:19.646608 6655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19c47a9e7c754e949cc9fee93f413c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.646616 6422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19c47a9e7c754e949cc9fee93f413c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.649600 7022 tablet_bootstrap.cc:492] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Bootstrap starting.
I20260808 07:02:19.649606 7027 tablet_bootstrap.cc:492] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Bootstrap starting.
I20260808 07:02:19.650285 7022 tablet_bootstrap.cc:654] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.650327 7027 tablet_bootstrap.cc:654] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.650215 6873 tablet_service.cc:1467] Processing CreateTablet for tablet 19c47a9e7c754e949cc9fee93f413c8a (DEFAULT_TABLE table=test-table [id=6eb973629390455b86fb45a77a16df28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:19.650542 6873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19c47a9e7c754e949cc9fee93f413c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.650559 7022 log.cc:824] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:19.650681 7027 log.cc:824] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:19.651261 7022 tablet_bootstrap.cc:492] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: No bootstrap required, opened a new log
I20260808 07:02:19.651321 7022 ts_tablet_manager.cc:1397] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:02:19.651400 7027 tablet_bootstrap.cc:492] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: No bootstrap required, opened a new log
I20260808 07:02:19.651454 7027 ts_tablet_manager.cc:1397] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:19.652828 7022 raft_consensus.cc:348] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.652974 7022 raft_consensus.cc:374] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.652998 7022 raft_consensus.cc:729] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.653086 7022 consensus_queue.cc:260] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.653348 7022 ts_tablet_manager.cc:1428] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:02:19.653432 6546 heartbeater.cc:503] Master 127.26.23.190:33291 was elected leader, sending a full tablet report...
I20260808 07:02:19.653522 7027 raft_consensus.cc:348] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.653954 7031 tablet_bootstrap.cc:492] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Bootstrap starting.
I20260808 07:02:19.654016 7027 raft_consensus.cc:374] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.654119 7027 raft_consensus.cc:729] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2160338f0eb24e9f9a966a8940d8550f, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.654268 7027 consensus_queue.cc:260] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.654496 7027 ts_tablet_manager.cc:1428] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:02:19.654573 6758 heartbeater.cc:503] Master 127.26.23.190:33291 was elected leader, sending a full tablet report...
I20260808 07:02:19.654619 7031 tablet_bootstrap.cc:654] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.654899 7031 log.cc:824] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:19.655484 7031 tablet_bootstrap.cc:492] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: No bootstrap required, opened a new log
I20260808 07:02:19.655534 7031 ts_tablet_manager.cc:1397] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:19.656922 7031 raft_consensus.cc:348] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.657051 7031 raft_consensus.cc:374] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.657071 7031 raft_consensus.cc:729] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.657178 7031 consensus_queue.cc:260] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.657407 7031 ts_tablet_manager.cc:1428] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:02:19.657456 6991 heartbeater.cc:503] Master 127.26.23.190:33291 was elected leader, sending a full tablet report...
W20260808 07:02:19.695355 6760 tablet.cc:2369] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:19.756636 7035 raft_consensus.cc:482] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:19.756752 7035 raft_consensus.cc:504] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.757079 7035 leader_election.cc:288] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743)
I20260808 07:02:19.759861 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.757476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:60961 (local address 127.26.23.129:36743)
0808 07:02:19.757546 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.757548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.757556 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:19.757582 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.757583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.757591 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.757639 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.757796 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.758285 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.759188 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.759548 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.759608 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.759619 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.759764 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.759796 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:02:19.759873 7036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.757269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36743 (local address 127.26.23.131:60961)
0808 07:02:19.757462 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.757470 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.757520 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.757670 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.757671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.757672 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.757736 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.757738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.758358 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.758359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.759100 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.759102 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.759629 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.759630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.759699 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.759702 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.759746 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.759785 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":14,"thread_start_us":120,"threads_started":1}
I20260808 07:02:19.759927 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.757316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:51637 (local address 127.26.23.130:44081)
0808 07:02:19.757368 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.757369 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.757378 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:19.757482 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.757483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.757494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.757564 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.757721 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.758247 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.759188 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.759604 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.759669 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.759678 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.759821 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.759860 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:02:19.759956 6813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.757262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44081 (local address 127.26.23.131:51637)
0808 07:02:19.757329 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.757342 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.757393 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.757582 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.757583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.757585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.757651 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.757653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.758311 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.758312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.759099 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.759102 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.759677 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.759678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.759758 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.759761 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.759806 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.759844 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":27}
I20260808 07:02:19.760289 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c47a9e7c754e949cc9fee93f413c8a" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f" is_pre_election: true
I20260808 07:02:19.760291 6467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c47a9e7c754e949cc9fee93f413c8a" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" is_pre_election: true
I20260808 07:02:19.760434 6467 raft_consensus.cc:2454] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 0.
I20260808 07:02:19.760435 6692 raft_consensus.cc:2454] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 0.
I20260808 07:02:19.760648 6808 leader_election.cc:302] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 326242bc9bf042c4abb082abfd0bb298, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:19.760767 7035 raft_consensus.cc:2781] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:19.760823 7035 raft_consensus.cc:482] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:19.760846 7035 raft_consensus.cc:3037] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.761785 7035 raft_consensus.cc:504] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.761912 7035 leader_election.cc:288] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 election: Requested vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743)
I20260808 07:02:19.762084 6467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c47a9e7c754e949cc9fee93f413c8a" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd"
I20260808 07:02:19.762068 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19c47a9e7c754e949cc9fee93f413c8a" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f"
I20260808 07:02:19.762179 6467 raft_consensus.cc:3037] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.762187 6692 raft_consensus.cc:3037] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.762836 6467 raft_consensus.cc:2454] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 1.
I20260808 07:02:19.762916 6692 raft_consensus.cc:2454] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 1.
I20260808 07:02:19.763001 6808 leader_election.cc:302] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 326242bc9bf042c4abb082abfd0bb298, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:19.763093 7035 raft_consensus.cc:2781] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:19.763250 7035 raft_consensus.cc:686] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 1 LEADER]: Becoming Leader. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Running, Role: LEADER
I20260808 07:02:19.763332 7035 consensus_queue.cc:237] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } }
I20260808 07:02:19.764106 6206 catalog_manager.cc:5495] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 reported cstate change: term changed from 0 to 1, leader changed from <none> to 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131). New cstate: current_term: 1 leader_uuid: "326242bc9bf042c4abb082abfd0bb298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } health_report { overall_health: UNKNOWN } } }
I20260808 07:02:19.787546 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.785193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42918 (local address 127.26.23.131:46591)
0808 07:02:19.785250 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.785252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.785260 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:19.785296 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.785297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.785316 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.785377 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:19.785490 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.786071 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.786831 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.787034 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.787090 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.787242 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:19.787344 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:19.787411 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.787453 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.787473 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:02:19.789271 6692 raft_consensus.cc:1261] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Refusing update from remote peer 326242bc9bf042c4abb082abfd0bb298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:19.789304 6467 raft_consensus.cc:1261] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Refusing update from remote peer 326242bc9bf042c4abb082abfd0bb298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:19.789608 7037 consensus_queue.cc:1035] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:19.789729 7035 consensus_queue.cc:1035] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:19.793004 7041 mvcc.cc:205] Tried to move back new op lower bound from 7316162722974375936 to 7316162722871255040. Current Snapshot: MvccSnapshot[applied={T|T < 7316162722974375936 or (T in {7316162722974375936})}]
I20260808 07:02:19.794566 6206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:19.794677 6206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:19.795441 6206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Sending DeleteTablet for 3 replicas of tablet 19c47a9e7c754e949cc9fee93f413c8a
I20260808 07:02:19.795755 6873 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c47a9e7c754e949cc9fee93f413c8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:19 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:42904
I20260808 07:02:19.795776 6655 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c47a9e7c754e949cc9fee93f413c8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:19 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:55414
I20260808 07:02:19.795811 6422 tablet_service.cc:1514] Processing DeleteTablet for tablet 19c47a9e7c754e949cc9fee93f413c8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:19 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38958
I20260808 07:02:19.796021 7055 tablet_replica.cc:330] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: stopping tablet replica
I20260808 07:02:19.796124 7055 raft_consensus.cc:2229] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:19.796218 7055 raft_consensus.cc:2258] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:19.796173 6206 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38352:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:19.796307 6206 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:19.796581 7060 tablet_replica.cc:330] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: stopping tablet replica
I20260808 07:02:19.796717 7060 raft_consensus.cc:2229] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:19.796864 7060 raft_consensus.cc:2258] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:19.796954 7055 ts_tablet_manager.cc:1905] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:19.797446 7060 ts_tablet_manager.cc:1905] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:19.797799 6873 tablet_service.cc:1467] Processing CreateTablet for tablet 5d27e49fdfec4769b93287ab88437139 (DEFAULT_TABLE table=test-table [id=7777eec7f3784791a874d08f2dd42558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:19.797916 6873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d27e49fdfec4769b93287ab88437139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.798949 7060 ts_tablet_manager.cc:1918] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:19.798949 7055 ts_tablet_manager.cc:1918] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:19.799016 7055 log.cc:1196] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/19c47a9e7c754e949cc9fee93f413c8a
I20260808 07:02:19.799028 7060 log.cc:1196] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/19c47a9e7c754e949cc9fee93f413c8a
I20260808 07:02:19.799268 7060 ts_tablet_manager.cc:1939] T 19c47a9e7c754e949cc9fee93f413c8a P 2160338f0eb24e9f9a966a8940d8550f: Deleting consensus metadata
I20260808 07:02:19.799263 7031 tablet_bootstrap.cc:492] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Bootstrap starting.
I20260808 07:02:19.799268 7055 ts_tablet_manager.cc:1939] T 19c47a9e7c754e949cc9fee93f413c8a P 326242bc9bf042c4abb082abfd0bb298: Deleting consensus metadata
I20260808 07:02:19.799728 7031 tablet_bootstrap.cc:654] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.800110 6182 catalog_manager.cc:4841] TS 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081): tablet 19c47a9e7c754e949cc9fee93f413c8a (table test-table [id=6eb973629390455b86fb45a77a16df28]) successfully deleted
I20260808 07:02:19.800289 6187 catalog_manager.cc:4841] TS 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591): tablet 19c47a9e7c754e949cc9fee93f413c8a (table test-table [id=6eb973629390455b86fb45a77a16df28]) successfully deleted
I20260808 07:02:19.800324 6422 tablet_service.cc:1467] Processing CreateTablet for tablet 5d27e49fdfec4769b93287ab88437139 (DEFAULT_TABLE table=test-table [id=7777eec7f3784791a874d08f2dd42558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:19.800436 6422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d27e49fdfec4769b93287ab88437139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.801759 7022 tablet_bootstrap.cc:492] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Bootstrap starting.
I20260808 07:02:19.801942 6655 tablet_service.cc:1467] Processing CreateTablet for tablet 5d27e49fdfec4769b93287ab88437139 (DEFAULT_TABLE table=test-table [id=7777eec7f3784791a874d08f2dd42558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:19.802047 6655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d27e49fdfec4769b93287ab88437139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.802145 7022 tablet_bootstrap.cc:654] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.802474 7031 tablet_bootstrap.cc:492] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: No bootstrap required, opened a new log
I20260808 07:02:19.802510 7031 ts_tablet_manager.cc:1397] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:02:19.802626 7031 raft_consensus.cc:348] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.802675 7031 raft_consensus.cc:374] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.802687 7031 raft_consensus.cc:729] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.802724 7031 consensus_queue.cc:260] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.802801 7031 ts_tablet_manager.cc:1428] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.802996 7061 tablet_replica.cc:330] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: stopping tablet replica
I20260808 07:02:19.803098 7061 raft_consensus.cc:2229] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:19.803167 7027 tablet_bootstrap.cc:492] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Bootstrap starting.
I20260808 07:02:19.803198 7061 raft_consensus.cc:2258] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:19.803537 7027 tablet_bootstrap.cc:654] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.803671 7061 ts_tablet_manager.cc:1905] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:19.804114 7027 tablet_bootstrap.cc:492] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: No bootstrap required, opened a new log
I20260808 07:02:19.804164 7027 ts_tablet_manager.cc:1397] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:19.804312 7027 raft_consensus.cc:348] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.804375 7027 raft_consensus.cc:374] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.804376 7022 tablet_bootstrap.cc:492] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: No bootstrap required, opened a new log
I20260808 07:02:19.804394 7027 raft_consensus.cc:729] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2160338f0eb24e9f9a966a8940d8550f, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.804418 7022 ts_tablet_manager.cc:1397] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:02:19.804438 7027 consensus_queue.cc:260] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.804539 7027 ts_tablet_manager.cc:1428] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.804549 7022 raft_consensus.cc:348] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.804618 7022 raft_consensus.cc:374] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.804656 7022 raft_consensus.cc:729] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.804695 7022 consensus_queue.cc:260] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.804769 7022 ts_tablet_manager.cc:1428] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.805127 7061 ts_tablet_manager.cc:1918] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:19.805194 7061 log.cc:1196] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/19c47a9e7c754e949cc9fee93f413c8a
I20260808 07:02:19.805702 7061 ts_tablet_manager.cc:1939] T 19c47a9e7c754e949cc9fee93f413c8a P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting consensus metadata
I20260808 07:02:19.806047 6187 catalog_manager.cc:4841] TS ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743): tablet 19c47a9e7c754e949cc9fee93f413c8a (table test-table [id=6eb973629390455b86fb45a77a16df28]) successfully deleted
I20260808 07:02:19.807081 7030 raft_consensus.cc:482] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:19.807142 7030 raft_consensus.cc:504] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.807389 7030 leader_election.cc:288] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:19.810686 7068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.807533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44081 (local address 127.26.23.129:56769)
0808 07:02:19.807624 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.807637 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.807686 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.807872 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.807873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.807875 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.807947 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.807949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.808851 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.808853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.809713 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.809716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.810468 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.810470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.810543 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.810548 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.810590 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.810623 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":55,"threads_started":1}
I20260808 07:02:19.810714 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.807645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:56769 (local address 127.26.23.130:44081)
0808 07:02:19.807739 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.807741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.807749 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:19.807771 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.807772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.807783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.807858 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.808007 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.808762 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.809782 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.810375 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.810441 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.810451 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.810606 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.810650 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 07:02:19.810977 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d27e49fdfec4769b93287ab88437139" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f" is_pre_election: true
I20260808 07:02:19.811050 6692 raft_consensus.cc:2454] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 0.
I20260808 07:02:19.811237 6351 leader_election.cc:302] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2160338f0eb24e9f9a966a8940d8550f, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:19.811347 7030 raft_consensus.cc:2781] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:19.811373 7030 raft_consensus.cc:482] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:19.811393 7030 raft_consensus.cc:3037] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.812115 7030 raft_consensus.cc:504] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.812249 7030 leader_election.cc:288] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 election: Requested vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:19.812392 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d27e49fdfec4769b93287ab88437139" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f"
I20260808 07:02:19.812472 6692 raft_consensus.cc:3037] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.813154 6692 raft_consensus.cc:2454] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 1.
I20260808 07:02:19.813374 6351 leader_election.cc:302] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2160338f0eb24e9f9a966a8940d8550f, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:19.813496 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.807699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:53817 (local address 127.26.23.131:46591)
0808 07:02:19.807917 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.807919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.810808 (+ 2889us) server_negotiation.cc:407] Connection header received
0808 07:02:19.810899 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.810900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.810910 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.810935 (+ 25us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:19.811077 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.811574 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.812570 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.813124 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.813185 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.813195 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.813398 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.813439 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260808 07:02:19.813506 7030 raft_consensus.cc:2781] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:19.813647 7030 raft_consensus.cc:686] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 LEADER]: Becoming Leader. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Running, Role: LEADER
I20260808 07:02:19.813714 7068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.807544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:46591 (local address 127.26.23.129:53817)
0808 07:02:19.810753 (+ 3209us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.810764 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.810837 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.810990 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.810991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.810992 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:19.811020 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.811021 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.811648 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.811649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.812435 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.812438 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.813257 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.813258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.813319 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.813323 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.813578 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.813624 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3198,"thread_start_us":57,"threads_started":1}
I20260808 07:02:19.813726 7030 consensus_queue.cc:237] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.814026 6900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d27e49fdfec4769b93287ab88437139" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326242bc9bf042c4abb082abfd0bb298" is_pre_election: true
I20260808 07:02:19.814137 6900 raft_consensus.cc:2454] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 0.
I20260808 07:02:19.814252 6899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d27e49fdfec4769b93287ab88437139" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326242bc9bf042c4abb082abfd0bb298"
I20260808 07:02:19.814311 6899 raft_consensus.cc:3037] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.814541 6203 catalog_manager.cc:5495] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129). New cstate: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260808 07:02:19.814955 6899 raft_consensus.cc:2454] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 1.
W20260808 07:02:19.845671 6992 tablet.cc:2369] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.190@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:19.854398 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.846953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38360 (local address 127.26.23.190:33291)
0808 07:02:19.847015 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.847017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.847123 (+ 106us) server_negotiation.cc:407] Connection header received
0808 07:02:19.847204 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.847205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.847215 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.847254 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:19.847850 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.848332 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.849382 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.849639 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.849693 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.851972 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:19.851973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:19.851973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:19.851979 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:19.853190 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.853602 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.853625 (+ 23us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.853626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.853676 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:19.853848 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:19.853849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:19.853849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:19.853938 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:19.853980 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.854135 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.854300 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":34}
I20260808 07:02:19.854399 7086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.846894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33291 (local address 127.0.0.1:38360)
0808 07:02:19.847049 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.847060 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.847135 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.847278 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.847279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.847720 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:19.847782 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.847785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.848423 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.848424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.849291 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.849293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.849702 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.849703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.849770 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.850313 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:19.850318 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:19.851869 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:19.853265 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.853273 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.853275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.853530 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.853728 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:19.853728 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:19.853729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:19.853798 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:19.853988 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:19.853994 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:19.854043 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.854108 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.854251 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260808 07:02:19.856467 6203 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38360:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 07:02:19.856666 6203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:19.858059 6873 tablet_service.cc:1467] Processing CreateTablet for tablet 09769e2568f84b88bfd9cb4fee5f57d4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=58ffac9af9f04b809789abc12e138701]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:02:19.858111 6422 tablet_service.cc:1467] Processing CreateTablet for tablet 09769e2568f84b88bfd9cb4fee5f57d4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=58ffac9af9f04b809789abc12e138701]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:02:19.858254 6873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09769e2568f84b88bfd9cb4fee5f57d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.858318 6422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09769e2568f84b88bfd9cb4fee5f57d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.859287 7031 tablet_bootstrap.cc:492] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: Bootstrap starting.
I20260808 07:02:19.859566 7031 tablet_bootstrap.cc:654] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.859984 6655 tablet_service.cc:1467] Processing CreateTablet for tablet 09769e2568f84b88bfd9cb4fee5f57d4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=58ffac9af9f04b809789abc12e138701]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 07:02:19.860049 7031 tablet_bootstrap.cc:492] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: No bootstrap required, opened a new log
I20260808 07:02:19.860081 7031 ts_tablet_manager.cc:1397] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:02:19.860124 6655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09769e2568f84b88bfd9cb4fee5f57d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:19.860170 7031 raft_consensus.cc:348] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.860217 7031 raft_consensus.cc:374] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.860229 7031 raft_consensus.cc:729] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.860266 7031 consensus_queue.cc:260] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.860347 7031 ts_tablet_manager.cc:1428] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.860375 7052 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.860441 7052 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.861541 7027 tablet_bootstrap.cc:492] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: Bootstrap starting.
I20260808 07:02:19.861568 7022 tablet_bootstrap.cc:492] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: Bootstrap starting.
I20260808 07:02:19.861907 7027 tablet_bootstrap.cc:654] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.861989 7022 tablet_bootstrap.cc:654] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:19.862587 7022 tablet_bootstrap.cc:492] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: No bootstrap required, opened a new log
I20260808 07:02:19.862653 7022 ts_tablet_manager.cc:1397] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:19.862650 7027 tablet_bootstrap.cc:492] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: No bootstrap required, opened a new log
I20260808 07:02:19.862694 7027 ts_tablet_manager.cc:1397] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:19.862790 7022 raft_consensus.cc:348] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.862850 7022 raft_consensus.cc:374] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.862869 7022 raft_consensus.cc:729] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.862845 7027 raft_consensus.cc:348] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.862895 7027 raft_consensus.cc:374] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:19.862910 7027 raft_consensus.cc:729] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2160338f0eb24e9f9a966a8940d8550f, State: Initialized, Role: FOLLOWER
I20260808 07:02:19.862912 7022 consensus_queue.cc:260] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.862946 7027 consensus_queue.cc:260] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.862991 7022 ts_tablet_manager.cc:1428] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.863032 7027 ts_tablet_manager.cc:1428] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:19.863086 7032 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.863165 7032 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.863161 7030 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.863234 7030 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.928335 7030 raft_consensus.cc:482] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:19.928434 7030 raft_consensus.cc:504] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.928601 7030 leader_election.cc:288] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:19.928810 6899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09769e2568f84b88bfd9cb4fee5f57d4" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326242bc9bf042c4abb082abfd0bb298" is_pre_election: true
I20260808 07:02:19.928810 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09769e2568f84b88bfd9cb4fee5f57d4" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f" is_pre_election: true
I20260808 07:02:19.928911 6899 raft_consensus.cc:2454] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 0.
I20260808 07:02:19.928911 6692 raft_consensus.cc:2454] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 0.
I20260808 07:02:19.929088 6351 leader_election.cc:302] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2160338f0eb24e9f9a966a8940d8550f, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:19.929224 7030 raft_consensus.cc:2781] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:19.929277 7030 raft_consensus.cc:482] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:19.929292 7030 raft_consensus.cc:3037] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.930025 7030 raft_consensus.cc:504] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.930143 7030 leader_election.cc:288] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 election: Requested vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:19.930325 6899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09769e2568f84b88bfd9cb4fee5f57d4" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326242bc9bf042c4abb082abfd0bb298"
I20260808 07:02:19.930341 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09769e2568f84b88bfd9cb4fee5f57d4" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f"
I20260808 07:02:19.930408 6692 raft_consensus.cc:3037] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.930408 6899 raft_consensus.cc:3037] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:19.931150 6899 raft_consensus.cc:2454] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 1.
I20260808 07:02:19.931150 6692 raft_consensus.cc:2454] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 1.
I20260808 07:02:19.931351 6358 leader_election.cc:302] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 326242bc9bf042c4abb082abfd0bb298, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:19.931483 7030 raft_consensus.cc:2781] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:19.931545 7030 raft_consensus.cc:686] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 LEADER]: Becoming Leader. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Running, Role: LEADER
I20260808 07:02:19.931593 7030 consensus_queue.cc:237] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:19.931927 7078 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: TxnStatusTablet state changed. Reason: New leader ec34ae53a95e4373b8bf25d8ed56b7cd. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.932042 7078 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:02:19.932271 7093 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 07:02:19.932225 6203 catalog_manager.cc:5495] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129). New cstate: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260808 07:02:19.932382 7093 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 07:02:19.956609 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.953845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38968 (local address 127.26.23.129:36743)
0808 07:02:19.953891 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.953893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.953904 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:19.954000 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.954001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.954016 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.954081 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:19.954268 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.954763 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.955850 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.956040 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.956108 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.956306 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:19.956409 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:19.956464 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.956526 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.956546 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:02:19.956661 7086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.953787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36743 (local address 127.0.0.1:38968)
0808 07:02:19.953870 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.953881 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.953925 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.954096 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.954097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.954098 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:02:19.954177 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.954180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.954828 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.954829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.955754 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.955758 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.956115 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.956116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.956186 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.956203 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:02:19.956467 (+ 264us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:02:19.956474 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.956519 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.956570 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 07:02:19.957720 6692 raft_consensus.cc:1261] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Refusing update from remote peer ec34ae53a95e4373b8bf25d8ed56b7cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:19.957859 6899 raft_consensus.cc:1261] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Refusing update from remote peer ec34ae53a95e4373b8bf25d8ed56b7cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:19.958141 7078 consensus_queue.cc:1035] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:19.958309 7030 consensus_queue.cc:1035] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:19.958820 7032 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: TxnStatusTablet state changed. Reason: New leader ec34ae53a95e4373b8bf25d8ed56b7cd. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.958912 7032 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.958972 7052 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: TxnStatusTablet state changed. Reason: New leader ec34ae53a95e4373b8bf25d8ed56b7cd. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.959069 7052 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.959795 7030 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.959872 7030 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:02:19.960062 7052 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.960139 7052 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P 326242bc9bf042c4abb082abfd0bb298: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.960536 7030 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.960614 7030 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P ec34ae53a95e4373b8bf25d8ed56b7cd: This TxnStatusTablet replica's current role is: LEADER
I20260808 07:02:19.961237 7032 tablet_replica.cc:439] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } } }
I20260808 07:02:19.961323 7032 tablet_replica.cc:442] T 09769e2568f84b88bfd9cb4fee5f57d4 P 2160338f0eb24e9f9a966a8940d8550f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 07:02:19.963783 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.961775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.26.23.129:36743)
0808 07:02:19.961811 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.961813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.961820 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:19.961836 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.961837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.961845 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.961888 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:19.962001 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.962513 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.963194 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.963394 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.963446 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.963579 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:19.963609 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:19.963652 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.963707 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.963724 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:02:19.968550 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.965987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36595 (local address 127.26.23.129:36743)
0808 07:02:19.966036 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:19.966038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:19.966122 (+ 84us) server_negotiation.cc:407] Connection header received
0808 07:02:19.966223 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:19.966223 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:19.966231 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:19.966276 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:19.966411 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.966857 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.967918 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.968094 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.968137 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.968328 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:19.968356 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:19.968404 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:19.968469 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 07:02:19.968491 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":33}
I20260808 07:02:19.968662 7101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:19.965925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36743 (local address 127.26.23.129:36595)
0808 07:02:19.966058 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:19.966067 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:19.966127 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:19.966293 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:19.966294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:19.966295 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:02:19.966359 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.966361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.966920 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.966921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.967851 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:19.967853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:19.968155 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:19.968155 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:19.968219 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:19.968234 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:02:19.968418 (+ 184us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:02:19.968419 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:02:19.968468 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:02:19.968516 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":3,"thread_start_us":64,"threads_started":1}
I20260808 07:02:19.970484 6692 raft_consensus.cc:1261] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Refusing update from remote peer ec34ae53a95e4373b8bf25d8ed56b7cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:19.970587 6899 raft_consensus.cc:1261] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Refusing update from remote peer ec34ae53a95e4373b8bf25d8ed56b7cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:19.970753 7078 consensus_queue.cc:1035] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:19.970844 7030 consensus_queue.cc:1035] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:19.971879 7045 mvcc.cc:205] Tried to move back new op lower bound from 7316162723717808128 to 7316162723077791744. Current Snapshot: MvccSnapshot[applied={T|T < 7316162723717808128}]
I20260808 07:02:19.982059 6203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:19.982142 6203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38352:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:19.982736 6203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Sending DeleteTablet for 3 replicas of tablet 5d27e49fdfec4769b93287ab88437139
I20260808 07:02:19.983006 6655 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d27e49fdfec4769b93287ab88437139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:19 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:55414
I20260808 07:02:19.983037 6873 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d27e49fdfec4769b93287ab88437139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:19 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:42904
I20260808 07:02:19.983131 7060 tablet_replica.cc:330] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: stopping tablet replica
I20260808 07:02:19.983196 7060 raft_consensus.cc:2229] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:19.983198 6432 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d27e49fdfec4769b93287ab88437139 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:19 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38958
I20260808 07:02:19.983258 7060 raft_consensus.cc:2258] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:19.983295 7061 tablet_replica.cc:330] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: stopping tablet replica
I20260808 07:02:19.983318 7055 tablet_replica.cc:330] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: stopping tablet replica
I20260808 07:02:19.983340 7061 raft_consensus.cc:2229] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:19.983364 7055 raft_consensus.cc:2229] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:19.983399 7055 raft_consensus.cc:2258] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:19.983428 7061 raft_consensus.cc:2258] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:19.983752 7061 ts_tablet_manager.cc:1905] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:19.983755 7060 ts_tablet_manager.cc:1905] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:19.985387 7061 ts_tablet_manager.cc:1918] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:02:19.985409 7060 ts_tablet_manager.cc:1918] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:02:19.985437 7061 log.cc:1196] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/5d27e49fdfec4769b93287ab88437139
I20260808 07:02:19.985456 7060 log.cc:1196] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/5d27e49fdfec4769b93287ab88437139
I20260808 07:02:19.985689 7060 ts_tablet_manager.cc:1939] T 5d27e49fdfec4769b93287ab88437139 P 2160338f0eb24e9f9a966a8940d8550f: Deleting consensus metadata
I20260808 07:02:19.985692 7061 ts_tablet_manager.cc:1939] T 5d27e49fdfec4769b93287ab88437139 P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting consensus metadata
I20260808 07:02:19.986215 6182 catalog_manager.cc:4841] TS 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081): tablet 5d27e49fdfec4769b93287ab88437139 (table test-table [id=7777eec7f3784791a874d08f2dd42558]) successfully deleted
I20260808 07:02:19.987020 6187 catalog_manager.cc:4841] TS ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743): tablet 5d27e49fdfec4769b93287ab88437139 (table test-table [id=7777eec7f3784791a874d08f2dd42558]) successfully deleted
I20260808 07:02:19.987300 7055 ts_tablet_manager.cc:1905] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:19.988595 7055 ts_tablet_manager.cc:1918] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:02:19.988667 7055 log.cc:1196] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/5d27e49fdfec4769b93287ab88437139
I20260808 07:02:19.988876 7055 ts_tablet_manager.cc:1939] T 5d27e49fdfec4769b93287ab88437139 P 326242bc9bf042c4abb082abfd0bb298: Deleting consensus metadata
I20260808 07:02:19.989156 6187 catalog_manager.cc:4841] TS 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591): tablet 5d27e49fdfec4769b93287ab88437139 (table test-table [id=7777eec7f3784791a874d08f2dd42558]) successfully deleted
Aug 08 07:02:19 dist-test-slave-zj8q krb5kdc[6132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 07:02:20 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:20 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:02:20.008348 6311 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:20.002392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38372 (local address 127.26.23.190:33291)
0808 07:02:20.002460 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:20.002462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:20.002564 (+ 102us) server_negotiation.cc:407] Connection header received
0808 07:02:20.002641 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:20.002642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:20.002659 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:20.002706 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:20.003417 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.003907 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.004941 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.005143 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.005190 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.008278 (+ 3088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38372: BlockingRecv error: recv got EOF from 127.0.0.1:38372 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 07:02:20 dist-test-slave-zj8q krb5kdc[6132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172539, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM
I20260808 07:02:20.015573 6311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.009261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38388 (local address 127.26.23.190:33291)
0808 07:02:20.009299 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:20.009301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:20.009382 (+ 81us) server_negotiation.cc:407] Connection header received
0808 07:02:20.009437 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:20.009438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:20.009448 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:20.009498 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:20.009959 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.010497 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.011142 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.011316 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.011367 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.013371 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:20.013372 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:20.013373 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:20.013380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:20.014624 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:20.014913 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:20.014914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:20.014914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:20.014964 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:20.015126 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:20.015126 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:20.015127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:20.015225 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:20.015307 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:20.015407 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:02:20.015481 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:02:20.017009 6203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:20.017171 6203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:20.025847 6432 tablet_service.cc:1467] Processing CreateTablet for tablet 051f286655544efeb356f3026d251393 (DEFAULT_TABLE table=test-table [id=a1ca74696f684828b8aba60cc5abdda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:20.025995 6432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 051f286655544efeb356f3026d251393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:20.026386 6873 tablet_service.cc:1467] Processing CreateTablet for tablet 051f286655544efeb356f3026d251393 (DEFAULT_TABLE table=test-table [id=a1ca74696f684828b8aba60cc5abdda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:20.026394 6655 tablet_service.cc:1467] Processing CreateTablet for tablet 051f286655544efeb356f3026d251393 (DEFAULT_TABLE table=test-table [id=a1ca74696f684828b8aba60cc5abdda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:20.026506 6873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 051f286655544efeb356f3026d251393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:20.026532 6655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 051f286655544efeb356f3026d251393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:20.027755 7031 tablet_bootstrap.cc:492] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Bootstrap starting.
I20260808 07:02:20.027905 7022 tablet_bootstrap.cc:492] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Bootstrap starting.
I20260808 07:02:20.028110 7031 tablet_bootstrap.cc:654] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:20.028296 7022 tablet_bootstrap.cc:654] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:20.028640 7027 tablet_bootstrap.cc:492] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Bootstrap starting.
I20260808 07:02:20.029007 7027 tablet_bootstrap.cc:654] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:20.029618 7031 tablet_bootstrap.cc:492] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: No bootstrap required, opened a new log
I20260808 07:02:20.029668 7031 ts_tablet_manager.cc:1397] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:20.029755 7027 tablet_bootstrap.cc:492] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: No bootstrap required, opened a new log
I20260808 07:02:20.029800 7027 ts_tablet_manager.cc:1397] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:20.029778 7031 raft_consensus.cc:348] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.029846 7031 raft_consensus.cc:374] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:20.029860 7031 raft_consensus.cc:729] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Initialized, Role: FOLLOWER
I20260808 07:02:20.029896 7031 consensus_queue.cc:260] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.029979 7031 ts_tablet_manager.cc:1428] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:20.029958 7027 raft_consensus.cc:348] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.030025 7027 raft_consensus.cc:374] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:20.030046 7027 raft_consensus.cc:729] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2160338f0eb24e9f9a966a8940d8550f, State: Initialized, Role: FOLLOWER
I20260808 07:02:20.030088 7027 consensus_queue.cc:260] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.030226 7027 ts_tablet_manager.cc:1428] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:20.030557 7022 tablet_bootstrap.cc:492] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: No bootstrap required, opened a new log
I20260808 07:02:20.030608 7022 ts_tablet_manager.cc:1397] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:02:20.030755 7022 raft_consensus.cc:348] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.030819 7022 raft_consensus.cc:374] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:20.030839 7022 raft_consensus.cc:729] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Initialized, Role: FOLLOWER
I20260808 07:02:20.030889 7022 consensus_queue.cc:260] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.030979 7022 ts_tablet_manager.cc:1428] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260808 07:02:20.042936 6547 tablet.cc:2369] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:02:20.164219 7106 raft_consensus.cc:482] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:20.164333 7106 raft_consensus.cc:504] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.164515 7106 leader_election.cc:288] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:20.164739 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051f286655544efeb356f3026d251393" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f" is_pre_election: true
I20260808 07:02:20.164757 6899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051f286655544efeb356f3026d251393" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326242bc9bf042c4abb082abfd0bb298" is_pre_election: true
I20260808 07:02:20.164849 6692 raft_consensus.cc:2454] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 0.
I20260808 07:02:20.164861 6899 raft_consensus.cc:2454] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 0.
I20260808 07:02:20.165038 6351 leader_election.cc:302] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2160338f0eb24e9f9a966a8940d8550f, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:20.165164 7106 raft_consensus.cc:2781] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:20.165216 7106 raft_consensus.cc:482] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:20.165233 7106 raft_consensus.cc:3037] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:20.166074 7106 raft_consensus.cc:504] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.166235 7106 leader_election.cc:288] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 election: Requested vote from peers 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081), 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591)
I20260808 07:02:20.166416 6899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051f286655544efeb356f3026d251393" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "326242bc9bf042c4abb082abfd0bb298"
I20260808 07:02:20.166488 6899 raft_consensus.cc:3037] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:20.166549 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "051f286655544efeb356f3026d251393" candidate_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f"
I20260808 07:02:20.166723 6692 raft_consensus.cc:3037] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:20.167243 6899 raft_consensus.cc:2454] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 1.
I20260808 07:02:20.167429 6358 leader_election.cc:302] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 326242bc9bf042c4abb082abfd0bb298, ec34ae53a95e4373b8bf25d8ed56b7cd; no voters:
I20260808 07:02:20.167542 7106 raft_consensus.cc:2781] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:20.167606 7106 raft_consensus.cc:686] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 LEADER]: Becoming Leader. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Running, Role: LEADER
I20260808 07:02:20.167654 6692 raft_consensus.cc:2454] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec34ae53a95e4373b8bf25d8ed56b7cd in term 1.
I20260808 07:02:20.167675 7106 consensus_queue.cc:237] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.168254 6203 catalog_manager.cc:5495] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd reported cstate change: term changed from 0 to 1, leader changed from <none> to ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129). New cstate: current_term: 1 leader_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260808 07:02:20.175983 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.173768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.26.23.129:36743)
0808 07:02:20.173823 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:20.173825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:20.173849 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:02:20.173917 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:20.173918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:20.173929 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:20.173975 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:20.174085 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.174620 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.175365 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.175570 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.175632 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.175758 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:20.175793 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:20.175837 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:20.175897 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 07:02:20.175916 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:02:20.176620 6899 raft_consensus.cc:1261] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Refusing update from remote peer ec34ae53a95e4373b8bf25d8ed56b7cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:20.176636 6692 raft_consensus.cc:1261] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Refusing update from remote peer ec34ae53a95e4373b8bf25d8ed56b7cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:20.176848 7030 consensus_queue.cc:1035] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:20.176949 7106 consensus_queue.cc:1035] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:20.179466 6203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:20.179543 6203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:20.180020 6203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Sending DeleteTablet for 3 replicas of tablet 051f286655544efeb356f3026d251393
I20260808 07:02:20.180244 6432 tablet_service.cc:1514] Processing DeleteTablet for tablet 051f286655544efeb356f3026d251393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:20 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38958
I20260808 07:02:20.180270 6873 tablet_service.cc:1514] Processing DeleteTablet for tablet 051f286655544efeb356f3026d251393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:20 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:42904
I20260808 07:02:20.180367 7061 tablet_replica.cc:330] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: stopping tablet replica
I20260808 07:02:20.180364 7055 tablet_replica.cc:330] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: stopping tablet replica
I20260808 07:02:20.180421 7061 raft_consensus.cc:2229] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:20.180426 7055 raft_consensus.cc:2229] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:20.180470 7055 raft_consensus.cc:2258] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:20.180471 7061 raft_consensus.cc:2258] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:20.180444 6203 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:20.180598 6203 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:20.180709 6655 tablet_service.cc:1514] Processing DeleteTablet for tablet 051f286655544efeb356f3026d251393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:20 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:55414
I20260808 07:02:20.180788 7060 tablet_replica.cc:330] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: stopping tablet replica
I20260808 07:02:20.180799 7061 ts_tablet_manager.cc:1905] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:20.180830 7060 raft_consensus.cc:2229] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:20.180860 7060 raft_consensus.cc:2258] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:20.181145 7060 ts_tablet_manager.cc:1905] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:20.181968 7055 ts_tablet_manager.cc:1905] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:20.182097 7061 ts_tablet_manager.cc:1918] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:20.182169 7061 log.cc:1196] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/051f286655544efeb356f3026d251393
I20260808 07:02:20.182219 7060 ts_tablet_manager.cc:1918] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:20.182261 7060 log.cc:1196] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/051f286655544efeb356f3026d251393
I20260808 07:02:20.182387 7061 ts_tablet_manager.cc:1939] T 051f286655544efeb356f3026d251393 P ec34ae53a95e4373b8bf25d8ed56b7cd: Deleting consensus metadata
I20260808 07:02:20.182435 7060 ts_tablet_manager.cc:1939] T 051f286655544efeb356f3026d251393 P 2160338f0eb24e9f9a966a8940d8550f: Deleting consensus metadata
I20260808 07:02:20.182691 6187 catalog_manager.cc:4841] TS ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743): tablet 051f286655544efeb356f3026d251393 (table test-table [id=a1ca74696f684828b8aba60cc5abdda6]) successfully deleted
I20260808 07:02:20.182736 6182 catalog_manager.cc:4841] TS 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081): tablet 051f286655544efeb356f3026d251393 (table test-table [id=a1ca74696f684828b8aba60cc5abdda6]) successfully deleted
I20260808 07:02:20.183262 7055 ts_tablet_manager.cc:1918] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:20.183313 7055 log.cc:1196] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/051f286655544efeb356f3026d251393
I20260808 07:02:20.183478 7055 ts_tablet_manager.cc:1939] T 051f286655544efeb356f3026d251393 P 326242bc9bf042c4abb082abfd0bb298: Deleting consensus metadata
I20260808 07:02:20.183735 6187 catalog_manager.cc:4841] TS 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591): tablet 051f286655544efeb356f3026d251393 (table test-table [id=a1ca74696f684828b8aba60cc5abdda6]) successfully deleted
I20260808 07:02:20.184008 6432 tablet_service.cc:1467] Processing CreateTablet for tablet 9ce79260fb8e42aaa05c387658b9b351 (DEFAULT_TABLE table=test-table [id=cad4db4ee2ed47009522531523e65947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:20.184000 6873 tablet_service.cc:1467] Processing CreateTablet for tablet 9ce79260fb8e42aaa05c387658b9b351 (DEFAULT_TABLE table=test-table [id=cad4db4ee2ed47009522531523e65947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:20.184012 6655 tablet_service.cc:1467] Processing CreateTablet for tablet 9ce79260fb8e42aaa05c387658b9b351 (DEFAULT_TABLE table=test-table [id=cad4db4ee2ed47009522531523e65947]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:20.184110 6873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ce79260fb8e42aaa05c387658b9b351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:20.184113 6655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ce79260fb8e42aaa05c387658b9b351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:20.184118 6432 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ce79260fb8e42aaa05c387658b9b351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:20.184885 7027 tablet_bootstrap.cc:492] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Bootstrap starting.
I20260808 07:02:20.185272 7031 tablet_bootstrap.cc:492] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Bootstrap starting.
I20260808 07:02:20.185273 7022 tablet_bootstrap.cc:492] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd: Bootstrap starting.
I20260808 07:02:20.185464 7027 tablet_bootstrap.cc:654] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:20.185573 7031 tablet_bootstrap.cc:654] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:20.185571 7022 tablet_bootstrap.cc:654] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:20.186094 7031 tablet_bootstrap.cc:492] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: No bootstrap required, opened a new log
I20260808 07:02:20.186175 7031 ts_tablet_manager.cc:1397] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:20.186313 7027 tablet_bootstrap.cc:492] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: No bootstrap required, opened a new log
I20260808 07:02:20.186285 7031 raft_consensus.cc:348] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.186347 7031 raft_consensus.cc:374] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:20.186348 7027 ts_tablet_manager.cc:1397] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:20.186367 7031 raft_consensus.cc:729] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Initialized, Role: FOLLOWER
I20260808 07:02:20.186412 7031 consensus_queue.cc:260] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.186496 7031 ts_tablet_manager.cc:1428] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:20.186475 7027 raft_consensus.cc:348] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.186530 7027 raft_consensus.cc:374] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:20.186549 7027 raft_consensus.cc:729] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2160338f0eb24e9f9a966a8940d8550f, State: Initialized, Role: FOLLOWER
I20260808 07:02:20.186591 7027 consensus_queue.cc:260] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.186683 7027 ts_tablet_manager.cc:1428] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:20.186990 7022 tablet_bootstrap.cc:492] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd: No bootstrap required, opened a new log
I20260808 07:02:20.187036 7022 ts_tablet_manager.cc:1397] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:02:20.187129 7022 raft_consensus.cc:348] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.187186 7022 raft_consensus.cc:374] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:20.187201 7022 raft_consensus.cc:729] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec34ae53a95e4373b8bf25d8ed56b7cd, State: Initialized, Role: FOLLOWER
I20260808 07:02:20.187233 7022 consensus_queue.cc:260] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.187296 7022 ts_tablet_manager.cc:1428] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:20.200654 7052 raft_consensus.cc:482] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:20.200729 7052 raft_consensus.cc:504] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.200870 7052 leader_election.cc:288] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743), 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081)
I20260808 07:02:20.201038 6467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce79260fb8e42aaa05c387658b9b351" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" is_pre_election: true
I20260808 07:02:20.201038 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce79260fb8e42aaa05c387658b9b351" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f" is_pre_election: true
I20260808 07:02:20.201138 6467 raft_consensus.cc:2454] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 0.
I20260808 07:02:20.201148 6692 raft_consensus.cc:2454] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 0.
I20260808 07:02:20.201278 6804 leader_election.cc:302] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2160338f0eb24e9f9a966a8940d8550f, 326242bc9bf042c4abb082abfd0bb298; no voters:
I20260808 07:02:20.201385 7052 raft_consensus.cc:2781] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:20.201419 7052 raft_consensus.cc:482] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:20.201447 7052 raft_consensus.cc:3037] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:20.202033 7052 raft_consensus.cc:504] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.202283 7052 leader_election.cc:288] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 election: Requested vote from peers ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743), 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081)
I20260808 07:02:20.202350 6692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce79260fb8e42aaa05c387658b9b351" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2160338f0eb24e9f9a966a8940d8550f"
I20260808 07:02:20.202356 6467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce79260fb8e42aaa05c387658b9b351" candidate_uuid: "326242bc9bf042c4abb082abfd0bb298" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd"
I20260808 07:02:20.202426 6467 raft_consensus.cc:3037] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:20.202426 6692 raft_consensus.cc:3037] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:20.203128 6692 raft_consensus.cc:2454] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 1.
I20260808 07:02:20.203135 6467 raft_consensus.cc:2454] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 326242bc9bf042c4abb082abfd0bb298 in term 1.
I20260808 07:02:20.203290 6804 leader_election.cc:302] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2160338f0eb24e9f9a966a8940d8550f, 326242bc9bf042c4abb082abfd0bb298; no voters:
I20260808 07:02:20.203394 7052 raft_consensus.cc:2781] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:20.203444 7052 raft_consensus.cc:686] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 1 LEADER]: Becoming Leader. State: Replica: 326242bc9bf042c4abb082abfd0bb298, State: Running, Role: LEADER
I20260808 07:02:20.203492 7052 consensus_queue.cc:237] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } }
I20260808 07:02:20.203954 6206 catalog_manager.cc:5495] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 reported cstate change: term changed from 0 to 1, leader changed from <none> to 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131). New cstate: current_term: 1 leader_uuid: "326242bc9bf042c4abb082abfd0bb298" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "326242bc9bf042c4abb082abfd0bb298" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 46591 } health_report { overall_health: HEALTHY } } }
I20260808 07:02:20.210451 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.208534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.26.23.131:46591)
0808 07:02:20.208569 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:20.208571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:20.208578 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:20.208626 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:20.208627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:20.208635 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:20.208676 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:20.208759 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.209257 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.209953 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.210137 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.210220 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.210301 (+ 81us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:20.210326 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:20.210355 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:20.210386 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 07:02:20.210402 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:02:20.214866 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.212687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38929 (local address 127.26.23.129:36743)
0808 07:02:20.212753 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:20.212755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:20.212828 (+ 73us) server_negotiation.cc:407] Connection header received
0808 07:02:20.212887 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:20.212888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:20.212897 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:20.212943 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:20.213059 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.213508 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.214254 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.214442 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.214496 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.214654 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:20.214683 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:20.214724 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:20.214778 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 07:02:20.214797 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:02:20.214881 7152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.212607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36743 (local address 127.26.23.131:38929)
0808 07:02:20.212768 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:20.212779 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:20.212834 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:20.212949 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:20.212950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:20.212952 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:02:20.213009 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:20.213010 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.213574 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.213575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:20.214135 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:20.214137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.214502 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.214504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:20.214570 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.214584 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:02:20.214730 (+ 146us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:02:20.214731 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 07:02:20.214767 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 07:02:20.214812 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":88,"threads_started":1}
I20260808 07:02:20.216766 6692 raft_consensus.cc:1261] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Refusing update from remote peer 326242bc9bf042c4abb082abfd0bb298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:20.216781 6467 raft_consensus.cc:1261] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Refusing update from remote peer 326242bc9bf042c4abb082abfd0bb298: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:20.216955 7037 consensus_queue.cc:1035] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec34ae53a95e4373b8bf25d8ed56b7cd" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:20.217058 7052 consensus_queue.cc:1035] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2160338f0eb24e9f9a966a8940d8550f" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:20.223378 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.221186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:58767 (local address 127.26.23.131:46591)
0808 07:02:20.221228 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:20.221229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:20.221277 (+ 48us) server_negotiation.cc:407] Connection header received
0808 07:02:20.221348 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:20.221348 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:20.221360 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:20.221407 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:20.221513 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.222052 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.222776 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.222963 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.223022 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.223169 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:20.223200 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:20.223247 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:20.223288 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 07:02:20.223308 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:20.223389 7101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.221134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:46591 (local address 127.26.23.129:58767)
0808 07:02:20.221234 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:20.221245 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:20.221291 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:20.221416 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:20.221418 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:20.221420 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 07:02:20.221457 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:20.221458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.222116 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.222117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:20.222708 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:20.222711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:20.223043 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:20.223044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:20.223100 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:20.223106 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 07:02:20.223249 (+ 143us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 07:02:20.223251 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:20.223284 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 07:02:20.223321 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 07:02:20.229883 6203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:20.229969 6203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:20.230546 6203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e8b6f58463b4a51bab5c255016883bf: Sending DeleteTablet for 3 replicas of tablet 9ce79260fb8e42aaa05c387658b9b351
I20260808 07:02:20.230836 6655 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ce79260fb8e42aaa05c387658b9b351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:20 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:55414
I20260808 07:02:20.230875 6432 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ce79260fb8e42aaa05c387658b9b351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:20 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38958
I20260808 07:02:20.230947 7061 tablet_replica.cc:330] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd: stopping tablet replica
I20260808 07:02:20.230949 6873 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ce79260fb8e42aaa05c387658b9b351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:20 UTC) from {username='oryx', principal='oryx/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:42904
I20260808 07:02:20.230959 7060 tablet_replica.cc:330] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: stopping tablet replica
I20260808 07:02:20.231002 7061 raft_consensus.cc:2229] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:20.231027 7060 raft_consensus.cc:2229] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:20.231037 7061 raft_consensus.cc:2258] T 9ce79260fb8e42aaa05c387658b9b351 P ec34ae53a95e4373b8bf25d8ed56b7cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:20.231027 7055 tablet_replica.cc:330] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: stopping tablet replica
I20260808 07:02:20.231066 7060 raft_consensus.cc:2258] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:20.231076 7055 raft_consensus.cc:2229] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:20.231125 7055 raft_consensus.cc:2258] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:20.231292 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 6317
I20260808 07:02:20.237054 7055 ts_tablet_manager.cc:1905] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:20.237818 7060 ts_tablet_manager.cc:1905] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:20.238590 7055 ts_tablet_manager.cc:1918] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:02:20.238683 7055 log.cc:1196] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/9ce79260fb8e42aaa05c387658b9b351
I20260808 07:02:20.238875 7055 ts_tablet_manager.cc:1939] T 9ce79260fb8e42aaa05c387658b9b351 P 326242bc9bf042c4abb082abfd0bb298: Deleting consensus metadata
I20260808 07:02:20.239172 7060 ts_tablet_manager.cc:1918] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 07:02:20.239233 7060 log.cc:1196] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/9ce79260fb8e42aaa05c387658b9b351
I20260808 07:02:20.239290 6187 catalog_manager.cc:4841] TS 326242bc9bf042c4abb082abfd0bb298 (127.26.23.131:46591): tablet 9ce79260fb8e42aaa05c387658b9b351 (table test-table [id=cad4db4ee2ed47009522531523e65947]) successfully deleted
I20260808 07:02:20.239450 7060 ts_tablet_manager.cc:1939] T 9ce79260fb8e42aaa05c387658b9b351 P 2160338f0eb24e9f9a966a8940d8550f: Deleting consensus metadata
I20260808 07:02:20.239845 6182 catalog_manager.cc:4841] TS 2160338f0eb24e9f9a966a8940d8550f (127.26.23.130:44081): tablet 9ce79260fb8e42aaa05c387658b9b351 (table test-table [id=cad4db4ee2ed47009522531523e65947]) successfully deleted
W20260808 07:02:20.244294 6187 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:36743 (error 108)
I20260808 07:02:20.244520 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 6558
I20260808 07:02:20.248381 7157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:20.244649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36743 (local address 127.0.0.1:39008)
0808 07:02:20.248254 (+ 3605us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:20.248328 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:36743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3580,"thread_start_us":43,"threads_started":1}
W20260808 07:02:20.251876 6187 catalog_manager.cc:4584] TS ec34ae53a95e4373b8bf25d8ed56b7cd (127.26.23.129:36743): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9ce79260fb8e42aaa05c387658b9b351: Network error: Client connection negotiation failed: client connection to 127.26.23.129:36743: connect: Connection refused (error 111)
I20260808 07:02:20.258391 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 6776
I20260808 07:02:20.270709 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 6154
2026-08-08T07:02:20Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2546 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:20 dist-test-slave-zj8q krb5kdc[7162](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:20 dist-test-slave-zj8q krb5kdc[7162](info): set up 2 sockets
Aug 08 07:02:20 dist-test-slave-zj8q krb5kdc[7162](info): commencing operation
krb5kdc: starting...
W20260808 07:02:21.430989 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:21 dist-test-slave-zj8q krb5kdc[7162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:21.545954 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39453
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:34923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:21.625890 7181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:21.626088 7181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:21.626118 7181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:21.627279 7181 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:21.627332 7181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:21.627350 7181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:21.627362 7181 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:21.627373 7181 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:21.628814 7181 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:34923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:21.628999 7181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:21.629189 7181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:21.633911 7189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:21.633932 7190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:21.633980 7181 server_base.cc:1034] running on GCE node
W20260808 07:02:21.633932 7192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:21.634450 7181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:21.634733 7181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:21.635878 7181 hybrid_clock.cc:648] HybridClock initialized: now 1786172541635862 us; error 28 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T07:02:21Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1364 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:21 dist-test-slave-zj8q krb5kdc[7198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:21 dist-test-slave-zj8q krb5kdc[7198](info): set up 2 sockets
Aug 08 07:02:21 dist-test-slave-zj8q krb5kdc[7198](info): commencing operation
krb5kdc: starting...
W20260808 07:02:22.781527 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:22 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:22.898620 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42419
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:42419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:22.978765 7214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:22.978961 7214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:22.978981 7214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:22.980078 7214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:22.980120 7214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:22.980134 7214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:22.980144 7214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:22.980156 7214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:22.981581 7214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:42419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:22.981815 7214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:22.982050 7214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:22.986768 7222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:22.986773 7226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:22.986867 7214 server_base.cc:1034] running on GCE node
W20260808 07:02:22.986778 7221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:22.987217 7214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:22.987486 7214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:22.988622 7214 hybrid_clock.cc:648] HybridClock initialized: now 1786172542988609 us; error 31 us; skew 500 ppm
Aug 08 07:02:22 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172542, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:22.994741 7214 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:22.995149 7214 webserver.cc:460] Webserver started at http://127.26.23.190:39795/ using document root <none> and password file <none>
I20260808 07:02:22.995337 7214 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:22.995375 7214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:22.995465 7214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:22.996490 7214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "71dd7dea57bd4048a95cb489b3f47191"
format_stamp: "Formatted at 2026-08-08 07:02:22 on dist-test-slave-zj8q"
server_key: "c02f0cb4164d7cb6eaac0cd39dddbea2"
server_key_iv: "bd52c448ed9cc42c1a96469619f7ec98"
server_key_version: "encryptionkey@0"
I20260808 07:02:22.996798 7214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "71dd7dea57bd4048a95cb489b3f47191"
format_stamp: "Formatted at 2026-08-08 07:02:22 on dist-test-slave-zj8q"
server_key: "c02f0cb4164d7cb6eaac0cd39dddbea2"
server_key_iv: "bd52c448ed9cc42c1a96469619f7ec98"
server_key_version: "encryptionkey@0"
I20260808 07:02:22.997947 7214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:22.998632 7234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:22.998787 7214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:22.998874 7214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "71dd7dea57bd4048a95cb489b3f47191"
format_stamp: "Formatted at 2026-08-08 07:02:22 on dist-test-slave-zj8q"
server_key: "c02f0cb4164d7cb6eaac0cd39dddbea2"
server_key_iv: "bd52c448ed9cc42c1a96469619f7ec98"
server_key_version: "encryptionkey@0"
I20260808 07:02:22.998934 7214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:23.021804 7214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:23.023985 7214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:23.024137 7214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:23.028086 7214 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:42419
I20260808 07:02:23.028123 7309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:42419 every 8 connection(s)
I20260808 07:02:23.028473 7214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:23.029317 7310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:23.031652 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Bootstrap starting.
I20260808 07:02:23.032253 7310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:23.032528 7310 log.cc:824] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:23.033211 7310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: No bootstrap required, opened a new log
I20260808 07:02:23.033288 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 7214
I20260808 07:02:23.033403 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:23.033603 26718 external_mini_cluster.cc:1428] Setting key ea05269e3c67569cc08626f9b7f79488
I20260808 07:02:23.035187 7310 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.035347 7310 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:23.035385 7310 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71dd7dea57bd4048a95cb489b3f47191, State: Initialized, Role: FOLLOWER
I20260808 07:02:23.035549 7310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.035636 7310 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:23.035676 7310 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:23.035735 7310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:23.036695 7310 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.036798 7310 leader_election.cc:302] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71dd7dea57bd4048a95cb489b3f47191; no voters:
I20260808 07:02:23.036950 7310 leader_election.cc:288] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:23.037024 7315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:23.037196 7310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:23.037240 7315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 LEADER]: Becoming Leader. State: Replica: 71dd7dea57bd4048a95cb489b3f47191, State: Running, Role: LEADER
I20260808 07:02:23.037380 7315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.037762 7315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71dd7dea57bd4048a95cb489b3f47191. Latest consensus state: current_term: 1 leader_uuid: "71dd7dea57bd4048a95cb489b3f47191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } } }
I20260808 07:02:23.037782 7316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71dd7dea57bd4048a95cb489b3f47191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } } }
I20260808 07:02:23.037874 7316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:23.037833 7315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:23.038074 7329 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:23.038595 7329 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:23.040201 7329 catalog_manager.cc:1347] Generated new cluster ID: a59ddeefb72f44ad89b5e8f8a8764aac
I20260808 07:02:23.040261 7329 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:23.044946 7314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.034113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38466 (local address 127.26.23.190:42419)
0808 07:02:23.034299 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.034307 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.034332 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:02:23.035155 (+ 823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.035161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.035213 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.035331 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.036099 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.037167 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.038277 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.038955 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.039355 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.041487 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:23.041491 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:23.041491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:23.041503 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:23.043059 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.043389 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.043392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.043392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.043494 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.043671 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.043672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.043672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.043999 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:23.044165 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:23.044573 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 07:02:23.044737 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":98,"threads_started":1}
I20260808 07:02:23.050897 7329 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:23.051378 7329 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:23.053733 7329 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Generated new TSK 0
I20260808 07:02:23.053877 7329 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:02:23.078641 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42419
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:23.159723 7348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:23.159919 7348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:23.159950 7348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:23.161077 7348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:23.161115 7348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:23.161149 7348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:23.162586 7348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:23.162812 7348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:23.163015 7348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:23.167891 7361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.167896 7356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.167901 7357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.168228 7348 server_base.cc:1034] running on GCE node
I20260808 07:02:23.168443 7348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:23.168672 7348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:23.169857 7348 hybrid_clock.cc:648] HybridClock initialized: now 1786172543169841 us; error 28 us; skew 500 ppm
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:23.172585 7348 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:02:23.173007 7348 webserver.cc:460] Webserver started at http://127.26.23.129:42623/ using document root <none> and password file <none>
I20260808 07:02:23.173235 7348 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:23.173286 7348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:23.173410 7348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:23.174518 7348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "6aa7a7c99fbe4806b35b607d181f5fe6"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "885604f5c36945a9ece43673ff0386d6"
server_key_iv: "4196e8ca67db6cdb7060806399230e48"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.174863 7348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "6aa7a7c99fbe4806b35b607d181f5fe6"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "885604f5c36945a9ece43673ff0386d6"
server_key_iv: "4196e8ca67db6cdb7060806399230e48"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.176249 7348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.177057 7374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.177222 7348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:23.177309 7348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "6aa7a7c99fbe4806b35b607d181f5fe6"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "885604f5c36945a9ece43673ff0386d6"
server_key_iv: "4196e8ca67db6cdb7060806399230e48"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.177371 7348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:23.186396 7348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:23.188026 7348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:23.188154 7348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:23.188354 7348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:23.188650 7348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:23.188684 7348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.188710 7348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:23.188735 7348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.194341 7348 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:38341
I20260808 07:02:23.194407 7553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:38341 every 8 connection(s)
I20260808 07:02:23.194687 7348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:23.203529 7314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.195331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:41981 (local address 127.26.23.190:42419)
0808 07:02:23.195402 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.195405 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.195595 (+ 190us) server_negotiation.cc:407] Connection header received
0808 07:02:23.196051 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.196052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.196065 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.196115 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.197008 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.197518 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.198584 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.198807 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.198866 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.200831 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:23.200833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:23.200833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:23.200842 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:23.202256 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.202692 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.202693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.202693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.202747 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.202929 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.202930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.202930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.203034 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:23.203079 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:23.203392 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 07:02:23.203462 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:02:23.203698 7559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.195300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:41981)
0808 07:02:23.195474 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:23.195510 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:23.195973 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:23.196173 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:23.196176 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:23.196723 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:23.196909 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.196914 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.197594 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.197594 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.198434 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.198437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.198878 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.198879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.198971 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.199391 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:23.199399 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:23.200744 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:23.202335 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:23.202343 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:23.202344 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:23.202633 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:23.202797 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:23.202798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:23.202798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:23.202890 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:23.203136 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:23.203144 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:23.203273 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:02:23.203369 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:02:23.203494 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
I20260808 07:02:23.203836 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 7348
I20260808 07:02:23.203954 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:23.204182 26718 external_mini_cluster.cc:1428] Setting key a27c2edfe9436f83c6ce1c59d529acfc
I20260808 07:02:23.204209 7555 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42419
I20260808 07:02:23.204308 7555 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:23.204487 7555 heartbeater.cc:511] Master 127.26.23.190:42419 requested a full tablet report, sending...
I20260808 07:02:23.205008 7261 ts_manager.cc:194] Registered new tserver with Master: 6aa7a7c99fbe4806b35b607d181f5fe6 (127.26.23.129:38341)
I20260808 07:02:23.205633 7261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:41981
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:02:23.228904 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42419
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:23.310806 7564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:23.310992 7564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:23.311015 7564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:23.312115 7564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:23.312155 7564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:23.312179 7564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:23.313565 7564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:23.313760 7564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:23.313961 7564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:23.318656 7579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.318667 7577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.318856 7564 server_base.cc:1034] running on GCE node
W20260808 07:02:23.318668 7575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.319132 7564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:23.319346 7564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:23.320493 7564 hybrid_clock.cc:648] HybridClock initialized: now 1786172543320474 us; error 32 us; skew 500 ppm
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:23.322978 7564 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:02:23.323395 7564 webserver.cc:460] Webserver started at http://127.26.23.130:41003/ using document root <none> and password file <none>
I20260808 07:02:23.323604 7564 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:23.323660 7564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:23.323781 7564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:23.324791 7564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "baa4214b475547b1b294363ef4cd05e3"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "b109cb19021eb0d52b7158325ccb7b32"
server_key_iv: "7e9bf06307be75a0f2cfb163bed94435"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.325119 7564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "baa4214b475547b1b294363ef4cd05e3"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "b109cb19021eb0d52b7158325ccb7b32"
server_key_iv: "7e9bf06307be75a0f2cfb163bed94435"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.326386 7564 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:23.327060 7594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.327215 7564 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:23.327287 7564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "baa4214b475547b1b294363ef4cd05e3"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "b109cb19021eb0d52b7158325ccb7b32"
server_key_iv: "7e9bf06307be75a0f2cfb163bed94435"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.327347 7564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:23.336372 7564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:23.338145 7564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:23.338373 7564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:23.338593 7564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:23.338886 7564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:23.338918 7564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.338938 7564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:23.338956 7564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.344419 7564 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:38457
I20260808 07:02:23.344481 7774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:38457 every 8 connection(s)
I20260808 07:02:23.344761 7564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:23.353287 7314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.345426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:39331 (local address 127.26.23.190:42419)
0808 07:02:23.345478 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.345480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.345677 (+ 197us) server_negotiation.cc:407] Connection header received
0808 07:02:23.346136 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.346137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.346148 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.346238 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.347135 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.347655 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.348630 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.348826 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.348880 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.350826 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:23.350828 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:23.350828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:23.350836 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:23.352072 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.352434 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.352436 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.352436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.352491 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.352700 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.352700 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.352701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.352808 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:23.352864 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:23.353111 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 07:02:23.353198 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:02:23.353437 7779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.345382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:39331)
0808 07:02:23.345555 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:23.345596 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:23.346050 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:23.346304 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:23.346307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:23.346840 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:23.347021 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.347026 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.347729 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.347730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.348546 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.348548 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.348889 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.348890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.348988 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.349392 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:23.349400 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:23.350737 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:23.352152 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:23.352159 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:23.352161 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:23.352367 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:23.352546 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:23.352547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:23.352547 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:23.352645 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:23.352861 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:23.352868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:23.352997 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:02:23.353082 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:02:23.353239 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
I20260808 07:02:23.353844 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 7564
I20260808 07:02:23.353963 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:23.354063 7775 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42419
I20260808 07:02:23.354177 7775 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:23.354214 26718 external_mini_cluster.cc:1428] Setting key 9b23e13328349aff015b721876e15118
I20260808 07:02:23.354352 7775 heartbeater.cc:511] Master 127.26.23.190:42419 requested a full tablet report, sending...
I20260808 07:02:23.354745 7260 ts_manager.cc:194] Registered new tserver with Master: baa4214b475547b1b294363ef4cd05e3 (127.26.23.130:38457)
I20260808 07:02:23.355213 7260 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:39331
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:02:23.378437 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42419
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:23.460131 7782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:23.460331 7782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:23.460353 7782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:23.461462 7782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:23.461503 7782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:23.461527 7782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:23.463032 7782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:23.463260 7782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:23.463446 7782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:23.468257 7796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.468274 7793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.468344 7782 server_base.cc:1034] running on GCE node
W20260808 07:02:23.468277 7794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.468614 7782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:23.468824 7782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:23.469961 7782 hybrid_clock.cc:648] HybridClock initialized: now 1786172543469947 us; error 29 us; skew 500 ppm
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:23.472369 7782 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:02:23.472833 7782 webserver.cc:460] Webserver started at http://127.26.23.131:39719/ using document root <none> and password file <none>
I20260808 07:02:23.473060 7782 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:23.473110 7782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:23.473251 7782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:23.474326 7782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "458af8af4fec46d58b4d806de522fbb1"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "a6bdd9af28d7844c73b3d34717046f24"
server_key_iv: "92533185602d97e59c8fea0d53db7608"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.474669 7782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "458af8af4fec46d58b4d806de522fbb1"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "a6bdd9af28d7844c73b3d34717046f24"
server_key_iv: "92533185602d97e59c8fea0d53db7608"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.475961 7782 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.476940 7809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.477108 7782 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.477208 7782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "458af8af4fec46d58b4d806de522fbb1"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "a6bdd9af28d7844c73b3d34717046f24"
server_key_iv: "92533185602d97e59c8fea0d53db7608"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.477272 7782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:23.485989 7782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:23.487972 7782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:23.488101 7782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:23.488291 7782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:23.488569 7782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:23.488608 7782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.488636 7782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:23.488660 7782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.494518 7782 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:35049
I20260808 07:02:23.494565 7984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:35049 every 8 connection(s)
I20260808 07:02:23.494879 7782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:23.503273 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 7782
I20260808 07:02:23.503384 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:23.503530 7314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.495595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:41709 (local address 127.26.23.190:42419)
0808 07:02:23.495684 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.495686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.495823 (+ 137us) server_negotiation.cc:407] Connection header received
0808 07:02:23.496289 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.496291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.496300 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.496354 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.497232 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.497725 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.498857 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.499039 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.499086 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.501035 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:23.501036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:23.501037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:23.501043 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:23.502333 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.502713 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.502714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.502714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.502764 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:23.502939 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:23.502940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:23.502940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:23.503032 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:23.503076 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:23.503365 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 07:02:23.503442 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 07:02:23.503585 26718 external_mini_cluster.cc:1428] Setting key 8c97f38502fdae665999f96d3d2e450e
I20260808 07:02:23.503705 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.495514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:41709)
0808 07:02:23.495721 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:23.495761 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:23.496215 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:23.496407 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:23.496410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:23.496972 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:23.497165 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.497170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.497834 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.497835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.498788 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.498792 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.499110 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.499111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.499221 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.499630 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:23.499638 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:23.500944 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:23.502411 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:23.502418 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:23.502419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:23.502656 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:23.502808 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:23.502808 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:23.502809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:23.502898 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:23.503099 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:23.503106 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:23.503228 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 07:02:23.503317 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:02:23.503486 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":77,"threads_started":1}
I20260808 07:02:23.504122 7985 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42419
I20260808 07:02:23.504220 7985 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:23.504410 7985 heartbeater.cc:511] Master 127.26.23.190:42419 requested a full tablet report, sending...
I20260808 07:02:23.504760 7261 ts_manager.cc:194] Registered new tserver with Master: 458af8af4fec46d58b4d806de522fbb1 (127.26.23.131:35049)
I20260808 07:02:23.505112 7261 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:41709
I20260808 07:02:23.515167 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab.
Entry for principal oryx/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab.
WARNING: no policy specified for oryx/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab.
Entry for principal oryx/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab.
WARNING: no policy specified for oryx/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab.
Entry for principal oryx/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab.
I20260808 07:02:23.578559 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 7348
I20260808 07:02:23.590994 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 7564
I20260808 07:02:23.604727 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 7782
I20260808 07:02:23.615923 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 7214
I20260808 07:02:23.624737 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42419
--webserver_interface=127.26.23.190
--webserver_port=39795
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:42419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:23.704612 7998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:23.704814 7998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:23.704834 7998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:23.705953 7998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:23.705996 7998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:23.706008 7998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:23.706019 7998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:23.706030 7998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:23.707499 7998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:42419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=39795
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:23.707726 7998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:23.707923 7998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:23.712535 8005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.712700 7998 server_base.cc:1034] running on GCE node
W20260808 07:02:23.712584 8007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.712538 8004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.713035 7998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:23.713280 7998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:23.714412 7998 hybrid_clock.cc:648] HybridClock initialized: now 1786172543714390 us; error 36 us; skew 500 ppm
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:23.717002 7998 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:23.717368 7998 webserver.cc:460] Webserver started at http://127.26.23.190:39795/ using document root <none> and password file <none>
I20260808 07:02:23.717571 7998 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:23.717645 7998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:23.719038 7998 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.719760 8020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.719921 7998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.720013 7998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "71dd7dea57bd4048a95cb489b3f47191"
format_stamp: "Formatted at 2026-08-08 07:02:22 on dist-test-slave-zj8q"
server_key: "c02f0cb4164d7cb6eaac0cd39dddbea2"
server_key_iv: "bd52c448ed9cc42c1a96469619f7ec98"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.720338 7998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:23.732523 7998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:23.734572 7998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:23.734711 7998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:23.738523 7998 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:42419
I20260808 07:02:23.738562 8107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:42419 every 8 connection(s)
I20260808 07:02:23.738909 7998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:23.739315 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 7998
I20260808 07:02:23.739583 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:38341
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:42419
--webserver_port=42623
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:02:23.740401 8108 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:02:23.741092 8108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Bootstrap starting.
I20260808 07:02:23.750259 8108 log.cc:824] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:23.751847 8108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:02:23.752122 8108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Bootstrap complete.
I20260808 07:02:23.754317 8108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.754546 8108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71dd7dea57bd4048a95cb489b3f47191, State: Initialized, Role: FOLLOWER
I20260808 07:02:23.754695 8108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.754765 8108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:23.754805 8108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:23.754849 8108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:02:23.755780 8108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.755869 8108 leader_election.cc:302] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71dd7dea57bd4048a95cb489b3f47191; no voters:
I20260808 07:02:23.756032 8108 leader_election.cc:288] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:02:23.756085 8113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:02:23.756219 8113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [term 2 LEADER]: Becoming Leader. State: Replica: 71dd7dea57bd4048a95cb489b3f47191, State: Running, Role: LEADER
I20260808 07:02:23.756291 8108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:23.756307 8113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } }
I20260808 07:02:23.756563 8115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "71dd7dea57bd4048a95cb489b3f47191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } } }
I20260808 07:02:23.756654 8115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:23.756814 8116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71dd7dea57bd4048a95cb489b3f47191. Latest consensus state: current_term: 2 leader_uuid: "71dd7dea57bd4048a95cb489b3f47191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71dd7dea57bd4048a95cb489b3f47191" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42419 } } }
I20260808 07:02:23.756865 8116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:23.757927 8137 catalog_manager.cc:1259] Loaded cluster ID: a59ddeefb72f44ad89b5e8f8a8764aac
I20260808 07:02:23.757973 8137 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: loading cluster ID for follower catalog manager: success
I20260808 07:02:23.759155 8137 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: acquiring CA information for follower catalog manager: success
I20260808 07:02:23.759469 8137 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:02:23.759549 8126 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:23.759723 8126 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:23.759786 8126 catalog_manager.cc:1259] Loaded cluster ID: a59ddeefb72f44ad89b5e8f8a8764aac
I20260808 07:02:23.759814 8126 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:23.759963 8126 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:23.760030 8126 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 71dd7dea57bd4048a95cb489b3f47191: Loaded TSK: 0
I20260808 07:02:23.760147 8126 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:02:23.824395 8111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:23.824608 8111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:23.824645 8111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:23.825836 8111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:23.825881 8111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:23.825915 8111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:23.827418 8111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.129.keytab
--principal=oryx/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:38341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=42623
--tserver_master_addrs=127.26.23.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:23.827651 8111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:23.827873 8111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:23.832901 8149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.832907 8153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.832907 8147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.833213 8111 server_base.cc:1034] running on GCE node
I20260808 07:02:23.833405 8111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:23.833657 8111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:23.834800 8111 hybrid_clock.cc:648] HybridClock initialized: now 1786172543834784 us; error 32 us; skew 500 ppm
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:23.837249 8111 init.cc:377] Logged in from keytab as oryx/127.26.23.129@KRBTEST.COM (short username oryx)
I20260808 07:02:23.837708 8111 webserver.cc:460] Webserver started at http://127.26.23.129:42623/ using document root <none> and password file <none>
I20260808 07:02:23.837929 8111 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:23.837985 8111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:23.839321 8111 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.839883 8167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.840018 8111 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:23.840103 8111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "6aa7a7c99fbe4806b35b607d181f5fe6"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "885604f5c36945a9ece43673ff0386d6"
server_key_iv: "4196e8ca67db6cdb7060806399230e48"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.840435 8111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:23.866879 8111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:23.869055 8111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:23.869210 8111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:23.869453 8111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:23.869791 8111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:23.869828 8111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.869859 8111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:23.869884 8111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.876773 8111 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:38341
I20260808 07:02:23.876852 8357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:38341 every 8 connection(s)
I20260808 07:02:23.877182 8111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:23.885058 8361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.877891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:48291)
0808 07:02:23.878074 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:23.878130 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:23.878734 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:23.879146 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:23.879150 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:23.879888 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:23.880174 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.880180 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.881166 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.881166 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.881942 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.881944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.882500 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.882501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.882595 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.883003 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:23.883011 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:23.884919 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
W20260808 07:02:23.885191 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:23.878008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:48291 (local address 127.26.23.190:42419)
0808 07:02:23.878192 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.878200 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.878239 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:02:23.878907 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.878913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.878954 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.879062 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.880261 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.881097 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.882007 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.882432 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.882503 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.885037 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:48291: BlockingRecv error: recv got EOF from 127.26.23.129:48291 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
W20260808 07:02:23.885278 8359 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:42419 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.23.190:42419: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
I20260808 07:02:23.885577 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 8111
I20260808 07:02:23.885891 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:38457
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:42419
--webserver_port=41003
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:23.889541 8361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.885507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:37053)
0808 07:02:23.885561 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:23.885570 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:23.885604 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:23.885723 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:23.885724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:23.885833 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:23.885874 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.885875 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.886627 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.886628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.887105 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.887107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.887503 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.887504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.887566 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.887899 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:23.887904 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:23.889498 (+ 1594us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 07:02:23.889657 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:23.885569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:37053 (local address 127.26.23.190:42419)
0808 07:02:23.885609 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.885611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.885622 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:23.885646 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.885647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.885659 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.885720 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.885940 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.886555 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.887176 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.887428 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.887496 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.889598 (+ 2102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:37053: BlockingRecv error: recv got EOF from 127.26.23.129:37053 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:23.894001 8361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:23.889745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:32871)
0808 07:02:23.889863 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:23.889872 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:23.889908 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:23.890051 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:23.890052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:23.890185 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:23.890213 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.890214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.890996 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.890996 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.891692 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:23.891695 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.892132 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.892133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:23.892188 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.892541 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:23.892544 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:23.893941 (+ 1397us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
W20260808 07:02:23.894075 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:23.889888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:32871 (local address 127.26.23.190:42419)
0808 07:02:23.889942 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:23.889944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:23.889954 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:23.889974 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:23.889975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:23.889985 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:23.890039 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:23.890269 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.890926 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.891808 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:23.892051 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:23.892105 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:23.894025 (+ 1920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:32871: BlockingRecv error: recv got EOF from 127.26.23.129:32871 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260808 07:02:23.894109 8359 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:02:23.974400 8363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:23.974758 8363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:23.974807 8363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:23.976392 8363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:23.976431 8363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:23.976461 8363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:23.978214 8363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.130.keytab
--principal=oryx/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:38457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=41003
--tserver_master_addrs=127.26.23.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:23.978466 8363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:23.978739 8363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:23.984089 8370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.984164 8372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:23.984306 8369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:23.984911 8363 server_base.cc:1034] running on GCE node
I20260808 07:02:23.985126 8363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:23.985395 8363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:23.986547 8363 hybrid_clock.cc:648] HybridClock initialized: now 1786172543986525 us; error 35 us; skew 500 ppm
Aug 08 07:02:23 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172543, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:23.989403 8363 init.cc:377] Logged in from keytab as oryx/127.26.23.130@KRBTEST.COM (short username oryx)
I20260808 07:02:23.990428 8363 webserver.cc:460] Webserver started at http://127.26.23.130:41003/ using document root <none> and password file <none>
I20260808 07:02:23.990674 8363 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:23.990760 8363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:23.992434 8363 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:23.993146 8385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:23.993320 8363 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:23.993398 8363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "baa4214b475547b1b294363ef4cd05e3"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "b109cb19021eb0d52b7158325ccb7b32"
server_key_iv: "7e9bf06307be75a0f2cfb163bed94435"
server_key_version: "encryptionkey@0"
I20260808 07:02:23.993830 8363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:24.017727 8363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:24.020748 8363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:24.020893 8363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:24.021116 8363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:24.021458 8363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:24.021505 8363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:24.021534 8363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:24.021559 8363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:24.028805 8363 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:38457
I20260808 07:02:24.028841 8573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:38457 every 8 connection(s)
I20260808 07:02:24.029263 8363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:24.031751 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 8363
I20260808 07:02:24.032038 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:35049
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:42419
--webserver_port=39719
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
W20260808 07:02:24.037307 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.030008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60687 (local address 127.26.23.190:42419)
0808 07:02:24.030072 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.030074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.030269 (+ 195us) server_negotiation.cc:407] Connection header received
0808 07:02:24.030741 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.030743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.030760 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.030837 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.031931 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.032723 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.033987 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.034235 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.034296 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.037251 (+ 2955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:60687: BlockingRecv error: recv got EOF from 127.26.23.130:60687 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:02:24.037351 8579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.029960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:60687)
0808 07:02:24.030132 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.030188 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.030656 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.030892 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.030895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.031521 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.031799 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.031807 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.032827 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.032828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.033906 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.033909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.034308 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.034309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.034421 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.034856 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.034864 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.037154 (+ 2290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
W20260808 07:02:24.037559 8575 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:42419 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.23.190:42419: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:24.042083 8579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.037750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:57735)
0808 07:02:24.037863 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.037875 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.037930 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.038087 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.038088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.038257 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.038311 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.038312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.038887 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.038888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.039635 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.039638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.039937 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.039938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.040009 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.040346 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.040350 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.042023 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95}
W20260808 07:02:24.042184 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.037812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:57735 (local address 127.26.23.190:42419)
0808 07:02:24.037876 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.037878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.037914 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:02:24.038006 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.038007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.038016 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.038063 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.038377 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.038819 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.039708 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.039877 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.039921 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.042110 (+ 2189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:57735: BlockingRecv error: recv got EOF from 127.26.23.130:57735 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:24.046765 8579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.042392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:57331)
0808 07:02:24.042467 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.042477 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.042510 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.042635 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.042635 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.042788 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.042820 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.042822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.043798 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.043799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.044302 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.044304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.044722 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.044723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.044755 (+ 32us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.045109 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.045112 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.046722 (+ 1610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 07:02:24.046864 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.042484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:57331 (local address 127.26.23.190:42419)
0808 07:02:24.042527 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.042528 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.042547 (+ 19us) server_negotiation.cc:407] Connection header received
0808 07:02:24.042582 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.042582 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.042591 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.042631 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.042887 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.043709 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.044364 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.044662 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.044727 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.046803 (+ 2076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:57331: BlockingRecv error: recv got EOF from 127.26.23.130:57331 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:02:24.046875 8575 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:02:24.115707 8580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:24.115906 8580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:24.115926 8580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:24.117060 8580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:24.117101 8580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:24.117128 8580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:24.118592 8580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/krb5kdc/oryx_127.26.23.131.keytab
--principal=oryx/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:35049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=39719
--tserver_master_addrs=127.26.23.190:42419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:24.118808 8580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:24.119007 8580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:02:24.123847 8580 server_base.cc:1034] running on GCE node
W20260808 07:02:24.123852 8587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:24.123831 8589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:24.123821 8586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:24.124245 8580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:24.124464 8580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:24.125594 8580 hybrid_clock.cc:648] HybridClock initialized: now 1786172544125576 us; error 36 us; skew 500 ppm
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172544, etypes {rep=17 tkt=17 ses=17}, oryx/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:24.128022 8580 init.cc:377] Logged in from keytab as oryx/127.26.23.131@KRBTEST.COM (short username oryx)
I20260808 07:02:24.128422 8580 webserver.cc:460] Webserver started at http://127.26.23.131:39719/ using document root <none> and password file <none>
I20260808 07:02:24.128623 8580 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:24.128682 8580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:24.129930 8580 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:02:24.130496 8601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:24.130623 8580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:24.130705 8580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "458af8af4fec46d58b4d806de522fbb1"
format_stamp: "Formatted at 2026-08-08 07:02:23 on dist-test-slave-zj8q"
server_key: "a6bdd9af28d7844c73b3d34717046f24"
server_key_iv: "92533185602d97e59c8fea0d53db7608"
server_key_version: "encryptionkey@0"
I20260808 07:02:24.131021 8580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:24.164557 8580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:24.166646 8580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:24.166766 8580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:24.167004 8580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:24.167303 8580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:24.167337 8580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:24.167358 8580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:24.167382 8580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:24.173144 8580 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:35049
I20260808 07:02:24.173195 8788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:35049 every 8 connection(s)
I20260808 07:02:24.173513 8580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:24.178355 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 8580
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:24.181102 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.174215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:45193)
0808 07:02:24.174362 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.174399 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.174900 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.175188 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.175192 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.175755 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.175948 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.175953 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.176647 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.176649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.177440 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.177443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.177790 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.177791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.177907 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.178401 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.178408 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.180903 (+ 2495us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":75,"threads_started":1}
W20260808 07:02:24.181380 8790 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:42419 (0 consecutive failures): Not authorized: Failed to ping master at 127.26.23.190:42419: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
W20260808 07:02:24.181427 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.174208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:45193 (local address 127.26.23.190:42419)
0808 07:02:24.174274 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.174276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.174485 (+ 209us) server_negotiation.cc:407] Connection header received
0808 07:02:24.175002 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.175004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.175016 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.175103 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.176057 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.176551 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.177528 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.177720 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.177777 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.181366 (+ 3589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:45193: BlockingRecv error: recv got EOF from 127.26.23.131:45193 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:24.186030 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.181600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:49699)
0808 07:02:24.181650 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.181658 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.181692 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.181843 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.181844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.181985 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.182033 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.182035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.182870 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.182871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.183461 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.183464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.183895 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.183896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.183964 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.184289 (+ 325us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.184294 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.185967 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 07:02:24.186110 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.181712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:49699 (local address 127.26.23.190:42419)
0808 07:02:24.181751 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.181753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.181759 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:02:24.181780 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.181781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.181789 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.181829 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.182099 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.182779 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.183549 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.183829 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.183878 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.186054 (+ 2176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:49699: BlockingRecv error: recv got EOF from 127.26.23.131:49699 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:24.186618 8795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.178842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38476 (local address 127.26.23.190:42419)
0808 07:02:24.178962 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.178964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.178972 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:24.178996 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.178997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.179009 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.179084 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.179810 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.180451 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.181708 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.181992 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.182057 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.183230 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:24.183235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:24.183235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:24.183246 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:24.184981 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:24.185323 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:24.185328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:24.185328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:24.185430 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:24.185645 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:24.185646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:24.185647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:24.185932 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:24.186064 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:24.186453 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 07:02:24.186557 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:24.189776 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.186406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:35251)
0808 07:02:24.186443 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.186451 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.186482 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.186592 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.186592 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.186730 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.186763 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.186765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.187382 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.187383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.187902 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.187904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.188173 (+ 269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.188173 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.188204 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.188469 (+ 265us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.188472 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.189735 (+ 1263us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 07:02:24.189858 8362 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.186465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:35251 (local address 127.26.23.190:42419)
0808 07:02:24.186505 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.186507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.186514 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:24.186531 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.186532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.186539 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.186579 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.186840 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.187328 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.187967 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.188135 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.188176 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.189806 (+ 1630us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:35251: BlockingRecv error: recv got EOF from 127.26.23.131:35251 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 07:02:24.189889 8790 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:24 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:24.899166 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:24.894484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:49065)
0808 07:02:24.894635 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:24.894647 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:24.894706 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:24.894840 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:24.894840 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:24.895009 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:24.895089 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.895091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.895859 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.895860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.896452 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:24.896454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.896784 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.896785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:24.896832 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.897261 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:24.897265 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:24.899099 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":62,"threads_started":1}
W20260808 07:02:24.899292 8799 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:24.894595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:49065 (local address 127.26.23.190:42419)
0808 07:02:24.894700 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:24.894702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:24.894710 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:24.894758 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:24.894758 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:24.894768 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:24.894822 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:24.895181 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.895800 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.896516 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:24.896726 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:24.896778 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:24.899214 (+ 2436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:49065: BlockingRecv error: recv got EOF from 127.26.23.129:49065 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":50,"threads_started":1}
Aug 08 07:02:25 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:25 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:25.051848 8800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:25.047264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:42313)
0808 07:02:25.047389 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:25.047399 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:25.047455 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:25.047631 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:25.047632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:25.047796 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:25.047846 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:25.047848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.048509 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.048510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:25.049070 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:25.049072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.049383 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.049383 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:25.049422 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:25.049851 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:25.049855 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:25.051753 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
W20260808 07:02:25.051918 8799 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:25.047322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:42313 (local address 127.26.23.190:42419)
0808 07:02:25.047404 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:25.047406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:25.047442 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:02:25.047514 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:25.047515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:25.047567 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:25.047610 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:25.047910 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.048441 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.049136 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.049331 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.049379 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:25.051860 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:42313: BlockingRecv error: recv got EOF from 127.26.23.130:42313 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 07:02:25 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:25 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:25.194434 8802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:25.190251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:38271)
0808 07:02:25.190370 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:25.190381 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:25.190438 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:25.190556 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:25.190557 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:25.190720 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:25.190771 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:25.190772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.191372 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.191373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:25.191903 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:25.191904 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.192250 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.192251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:25.192289 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:25.192676 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:25.192680 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:25.194370 (+ 1690us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
W20260808 07:02:25.194588 8799 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:25.190319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38271 (local address 127.26.23.190:42419)
0808 07:02:25.190385 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:25.190387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:25.190423 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:02:25.190490 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:25.190491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:25.190504 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:25.190543 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:25.190822 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.191319 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.191982 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.192193 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.192246 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:25.194460 (+ 2214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:38271: BlockingRecv error: recv got EOF from 127.26.23.131:38271 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:02:25 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:25 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:25.903895 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:25.899588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:52367)
0808 07:02:25.899715 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:25.899726 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:25.899781 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:25.899898 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:25.899899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:25.900067 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:25.900117 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:25.900118 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.900735 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.900736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:25.901262 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:25.901263 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.901561 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.901562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:25.901596 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:25.902109 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:25.902114 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:25.903835 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
W20260808 07:02:25.904034 8806 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:25.899667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:52367 (local address 127.26.23.190:42419)
0808 07:02:25.899765 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:25.899767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:25.899776 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:25.899823 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:25.899824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:25.899835 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:25.899889 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:25.900176 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.900682 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.901313 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:25.901516 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:25.901557 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:25.903962 (+ 2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:52367: BlockingRecv error: recv got EOF from 127.26.23.129:52367 (error 108)
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":50,"threads_started":1}
Aug 08 07:02:26 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:26 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:26.056950 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:26.052288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:43085)
0808 07:02:26.052444 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:26.052456 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:26.052523 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:26.052694 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:26.052695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:26.052862 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:26.052915 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:26.052917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.053526 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.053527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:26.054063 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:26.054065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.054411 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.054412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:26.054449 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:26.054878 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:26.054883 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:26.056890 (+ 2007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
W20260808 07:02:26.057053 8806 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:26.052385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:43085 (local address 127.26.23.190:42419)
0808 07:02:26.052446 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:26.052448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:26.052513 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:02:26.052583 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:26.052584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:26.052595 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:26.052667 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:26.052974 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.053471 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.054139 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.054361 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.054413 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:26.056990 (+ 2577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:43085: BlockingRecv error: recv got EOF from 127.26.23.130:43085 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 07:02:26 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:26 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:26.199080 8808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:26.194879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:58549)
0808 07:02:26.195028 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:26.195037 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:26.195096 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:26.195232 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:26.195233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:26.195395 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:26.195445 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:26.195447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.196035 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.196036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:26.196562 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:26.196564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.196851 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.196852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:26.196887 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:26.197287 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:26.197291 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:26.199020 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
W20260808 07:02:26.199203 8806 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:26.194998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:58549 (local address 127.26.23.190:42419)
0808 07:02:26.195052 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:26.195054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:26.195082 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:02:26.195156 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:26.195157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:26.195170 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:26.195218 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:26.195494 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.195983 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.196622 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.196802 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.196848 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:26.199131 (+ 2283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:58549: BlockingRecv error: recv got EOF from 127.26.23.131:58549 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 07:02:26 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:26 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:26.909260 8809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:26.904388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:57967)
0808 07:02:26.904542 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:26.904556 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:26.904626 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:26.904827 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:26.904828 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:26.904996 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:26.905060 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:26.905061 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.905735 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.905737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:26.906336 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:26.906339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.906743 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.906744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:26.906795 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:26.907264 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:26.907269 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:26.909188 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
W20260808 07:02:26.909373 8810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:26.904484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:57967 (local address 127.26.23.190:42419)
0808 07:02:26.904706 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:26.904708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:26.904716 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:26.904740 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:26.904740 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:26.904751 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:26.904808 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:26.905139 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.905664 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.906425 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:26.906673 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:26.906728 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:26.909290 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:57967: BlockingRecv error: recv got EOF from 127.26.23.129:57967 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":136,"threads_started":1}
Aug 08 07:02:27 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:27 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:27.062336 8814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:27.057404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:60769)
0808 07:02:27.057579 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:27.057589 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:27.057651 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:27.057785 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:27.057785 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:27.058002 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:27.058058 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:27.058060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.058732 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.058733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:27.059304 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:27.059307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.059713 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.059714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:27.059773 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:27.060276 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:27.060281 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:27.062239 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":102,"threads_started":1}
W20260808 07:02:27.062409 8810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:27.057485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60769 (local address 127.26.23.190:42419)
0808 07:02:27.057540 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:27.057542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:27.057647 (+ 105us) server_negotiation.cc:407] Connection header received
0808 07:02:27.057699 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:27.057700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:27.057712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:27.057770 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:27.058121 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.058658 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.059395 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.059612 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.059678 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:27.062345 (+ 2667us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:60769: BlockingRecv error: recv got EOF from 127.26.23.130:60769 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 07:02:27 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:27 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:27.204150 8819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:27.199533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:46743)
0808 07:02:27.199667 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:27.199678 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:27.199743 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:27.199854 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:27.199854 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:27.200035 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:27.200088 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:27.200090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.200761 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.200763 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:27.201309 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:27.201312 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.201670 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.201671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:27.201711 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:27.202138 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:27.202143 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:27.204057 (+ 1914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260808 07:02:27.204255 8810 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:27.199600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:46743 (local address 127.26.23.190:42419)
0808 07:02:27.199685 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:27.199687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:27.199739 (+ 52us) server_negotiation.cc:407] Connection header received
0808 07:02:27.199786 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:27.199787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:27.199800 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:27.199847 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:27.200151 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.200683 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.201387 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.201578 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.201631 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:27.204182 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:46743: BlockingRecv error: recv got EOF from 127.26.23.131:46743 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 07:02:27 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:27 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:27.914135 8820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:27.909742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:47923)
0808 07:02:27.909882 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:27.909893 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:27.909949 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:27.910070 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:27.910070 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:27.910261 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:27.910312 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:27.910314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.910956 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.910957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:27.911495 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:27.911497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.911823 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.911824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:27.911861 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:27.912379 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:27.912385 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:27.914072 (+ 1687us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
W20260808 07:02:27.914285 8821 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:27.909842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:47923 (local address 127.26.23.190:42419)
0808 07:02:27.909957 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:27.909959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:27.909966 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:27.909988 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:27.909989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:27.909999 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:27.910057 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:27.910367 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.910884 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.911559 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:27.911769 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:27.911818 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:27.914212 (+ 2394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:47923: BlockingRecv error: recv got EOF from 127.26.23.129:47923 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":54,"threads_started":1}
Aug 08 07:02:28 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:28 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:28.070497 8822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:28.062867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:38105)
0808 07:02:28.063027 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:28.063037 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:28.063095 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:28.063229 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:28.063229 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:28.063425 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:28.063476 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:28.063478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.064125 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.064126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:28.064691 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:28.064693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.065014 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.065015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:28.065051 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:28.068717 (+ 3666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:28.068722 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:28.070436 (+ 1714us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
W20260808 07:02:28.070622 8821 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:28.062941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:38105 (local address 127.26.23.190:42419)
0808 07:02:28.062997 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:28.062999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:28.063088 (+ 89us) server_negotiation.cc:407] Connection header received
0808 07:02:28.063156 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:28.063157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:28.063169 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:28.063216 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:28.063538 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.064050 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.064763 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.064958 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.065012 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:28.070556 (+ 5544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:38105: BlockingRecv error: recv got EOF from 127.26.23.130:38105 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 07:02:28 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:28 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:28.209228 8823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:28.204641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:35219)
0808 07:02:28.204809 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:28.204822 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:28.204896 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:28.205037 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:28.205038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:28.205216 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:28.205267 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:28.205269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.205954 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.205955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:28.206551 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:28.206554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.206896 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.206897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:28.206952 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:28.207405 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:28.207409 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:28.209149 (+ 1740us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
W20260808 07:02:28.209318 8821 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:28.204731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:35219 (local address 127.26.23.190:42419)
0808 07:02:28.204813 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:28.204816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:28.204884 (+ 68us) server_negotiation.cc:407] Connection header received
0808 07:02:28.204954 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:28.204955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:28.204969 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:28.205016 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:28.205343 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.205877 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.206633 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.206836 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.206893 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:28.209263 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:35219: BlockingRecv error: recv got EOF from 127.26.23.131:35219 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 07:02:28 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:28 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:28.919157 8824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:28.914559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:49167)
0808 07:02:28.914724 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:28.914735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:28.914798 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:28.914917 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:28.914918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:28.915081 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:28.915153 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:28.915155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.915846 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.915847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:28.916409 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:28.916411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.916774 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.916775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:28.916812 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:28.917411 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:28.917416 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:28.919090 (+ 1674us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":112,"threads_started":1}
W20260808 07:02:28.919252 8825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:28.914642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:49167 (local address 127.26.23.190:42419)
0808 07:02:28.914748 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:28.914750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:28.914788 (+ 38us) server_negotiation.cc:407] Connection header received
0808 07:02:28.914840 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:28.914841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:28.914851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:28.914907 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:28.915224 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.915778 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.916481 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:28.916721 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:28.916773 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:28.919180 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:49167: BlockingRecv error: recv got EOF from 127.26.23.129:49167 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":51,"threads_started":1}
Aug 08 07:02:29 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:29 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:29.075150 8826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:29.070951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:44801)
0808 07:02:29.071077 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:29.071087 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:29.071151 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:29.071269 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:29.071270 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:29.071438 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:29.071490 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:29.071491 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.072096 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.072098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:29.072633 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:29.072635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.072942 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.072943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:29.072980 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:29.073382 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:29.073386 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:29.075085 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
W20260808 07:02:29.075270 8825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:29.071108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:44801 (local address 127.26.23.190:42419)
0808 07:02:29.071165 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:29.071167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:29.071175 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:29.071198 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:29.071199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:29.071210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:29.071257 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:29.071540 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.072035 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.072700 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.072889 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.072939 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:29.075198 (+ 2259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:44801: BlockingRecv error: recv got EOF from 127.26.23.130:44801 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 07:02:29 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:29 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:29.214396 8830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:29.209779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:34255)
0808 07:02:29.209931 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:29.209944 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:29.210018 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:29.210188 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:29.210189 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:29.210371 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:29.210421 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:29.210423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.211078 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.211079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:29.211644 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:29.211646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.211979 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.211980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:29.212037 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:29.212504 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:29.212509 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:29.214315 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":68,"threads_started":1}
W20260808 07:02:29.214465 8825 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:29.209874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:34255 (local address 127.26.23.190:42419)
0808 07:02:29.209936 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:29.209938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:29.209995 (+ 57us) server_negotiation.cc:407] Connection header received
0808 07:02:29.210069 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:29.210070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:29.210084 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:29.210167 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:29.210495 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.211003 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.211727 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.211920 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.211973 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:29.214411 (+ 2438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:34255: BlockingRecv error: recv got EOF from 127.26.23.131:34255 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 08 07:02:29 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:29 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:29.924772 8833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:29.919615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:49223)
0808 07:02:29.919762 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:29.919772 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:29.919831 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:29.919958 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:29.919959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:29.920128 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:29.920199 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:29.920201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.920914 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.920916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:29.921584 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:29.921587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.921948 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.921949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:29.922012 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:29.922497 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:29.922501 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:29.924710 (+ 2209us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
W20260808 07:02:29.924896 8834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:29.919669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:49223 (local address 127.26.23.190:42419)
0808 07:02:29.919785 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:29.919787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:29.919817 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:02:29.919885 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:29.919885 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:29.919896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:29.919944 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:29.920256 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.920820 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.921667 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:29.921873 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:29.921924 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:29.924824 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:49223: BlockingRecv error: recv got EOF from 127.26.23.129:49223 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
Aug 08 07:02:30 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:30 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:30.080013 8835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:30.075610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:43461)
0808 07:02:30.075742 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:30.075752 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:30.075810 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:30.075934 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:30.075935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:30.076114 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:30.076165 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:30.076167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.076834 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.076835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:30.077396 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:30.077399 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.077733 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.077733 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:30.077771 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:30.078199 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:30.078204 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:30.079952 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
W20260808 07:02:30.080147 8834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:30.075679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:43461 (local address 127.26.23.190:42419)
0808 07:02:30.075748 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:30.075750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:30.075797 (+ 47us) server_negotiation.cc:407] Connection header received
0808 07:02:30.075869 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:30.075870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:30.075880 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:30.075919 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:30.076227 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.076740 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.077470 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.077677 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.077727 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:30.080048 (+ 2321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:43461: BlockingRecv error: recv got EOF from 127.26.23.130:43461 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:02:30 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:30 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:30.219218 8842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:30.214926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:53603)
0808 07:02:30.215071 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:30.215083 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:30.215152 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:30.215281 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:30.215282 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:30.215452 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:30.215522 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:30.215524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.216178 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.216179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:30.216695 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:30.216696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.216985 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.216986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:30.217030 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:30.217421 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:30.217425 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:30.219157 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":103,"threads_started":1}
W20260808 07:02:30.219308 8834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:30.215012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:53603 (local address 127.26.23.190:42419)
0808 07:02:30.215106 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:30.215109 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:30.215121 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:02:30.215210 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:30.215210 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:30.215225 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:30.215269 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:30.215595 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.216114 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.216754 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.216935 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.216982 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:30.219246 (+ 2264us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:53603: BlockingRecv error: recv got EOF from 127.26.23.131:53603 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 07:02:30 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:30 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:30.929746 8843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:30.925230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:41039)
0808 07:02:30.925361 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:30.925373 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:30.925439 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:30.925568 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:30.925569 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:30.925776 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:30.925828 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:30.925830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.926649 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.926651 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:30.927185 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:30.927187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.927523 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.927525 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:30.927580 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:30.927970 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:30.927975 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:30.929664 (+ 1689us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
W20260808 07:02:30.929822 8844 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:30.925305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:41039 (local address 127.26.23.190:42419)
0808 07:02:30.925443 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:30.925445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:30.925454 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:30.925478 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:30.925478 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:30.925488 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:30.925559 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:30.925904 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.926570 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.927256 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:30.927465 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:30.927518 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:30.929759 (+ 2241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:41039: BlockingRecv error: recv got EOF from 127.26.23.129:41039 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
Aug 08 07:02:31 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:31 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:31.084884 8845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:31.080468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:48563)
0808 07:02:31.080631 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:31.080642 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:31.080700 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:31.080827 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:31.080827 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:31.080997 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:31.081049 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:31.081050 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.081726 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.081728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:31.082337 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:31.082339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.082697 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.082698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:31.082739 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:31.083171 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:31.083175 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:31.084825 (+ 1650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
W20260808 07:02:31.084983 8844 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:31.080528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:48563 (local address 127.26.23.190:42419)
0808 07:02:31.080588 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:31.080590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:31.080695 (+ 105us) server_negotiation.cc:407] Connection header received
0808 07:02:31.080757 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:31.080758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:31.080770 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:31.080808 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:31.081140 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.081651 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.082413 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.082614 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.082692 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:31.084920 (+ 2228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:48563: BlockingRecv error: recv got EOF from 127.26.23.130:48563 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 07:02:31 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:31 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:31.224063 8846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:31.219696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:41165)
0808 07:02:31.219854 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:31.219866 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:31.219928 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:31.220044 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:31.220045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:31.220212 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:31.220266 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:31.220267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.220911 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.220911 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:31.221434 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:31.221435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.221741 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.221742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:31.221785 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:31.222242 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:31.222247 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:31.224001 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
W20260808 07:02:31.224172 8844 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:31.219771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:41165 (local address 127.26.23.190:42419)
0808 07:02:31.219822 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:31.219824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:31.219923 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:02:31.219979 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:31.219979 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:31.219994 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:31.220030 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:31.220315 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.220855 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.221488 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.221686 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.221730 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:31.224105 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:41165: BlockingRecv error: recv got EOF from 127.26.23.131:41165 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 07:02:31 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:31 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:31.934978 8848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:31.930355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:37565)
0808 07:02:31.930480 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:31.930491 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:31.930547 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:31.930744 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:31.930745 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:31.930907 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:31.930959 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:31.930961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.931637 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.931638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:31.932182 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:31.932184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.932511 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.932511 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:31.932549 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:31.932961 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:31.932965 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:31.934897 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
W20260808 07:02:31.935050 8849 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:31.930445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:37565 (local address 127.26.23.190:42419)
0808 07:02:31.930562 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:31.930564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:31.930573 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:31.930668 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:31.930669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:31.930681 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:31.930739 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:31.931011 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.931535 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.932259 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:31.932457 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:31.932505 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:31.934990 (+ 2485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:37565: BlockingRecv error: recv got EOF from 127.26.23.129:37565 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
Aug 08 07:02:32 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:32 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:32.089885 8851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:32.085352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:33489)
0808 07:02:32.085476 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:32.085485 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:32.085553 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:32.085681 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:32.085681 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:32.085851 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:32.085904 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:32.085906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.086757 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.086758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:32.087284 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:32.087286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.087638 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.087639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:32.087675 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:32.088085 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:32.088088 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:32.089823 (+ 1735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
W20260808 07:02:32.089972 8849 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:32.085411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:33489 (local address 127.26.23.190:42419)
0808 07:02:32.085480 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:32.085482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:32.085547 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:02:32.085599 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:32.085600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:32.085612 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:32.085668 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:32.085997 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.086697 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.087362 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.087578 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.087632 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:32.089912 (+ 2280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:33489: BlockingRecv error: recv got EOF from 127.26.23.130:33489 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 07:02:32 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:32 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:32.229046 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:32.224530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:57333)
0808 07:02:32.224694 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:32.224706 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:32.224771 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:32.224903 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:32.224904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:32.225086 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:32.225137 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:32.225139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.225798 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.225800 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:32.226372 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:32.226376 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.226710 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.226711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:32.226765 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:32.227183 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:32.227186 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:32.228985 (+ 1799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":59,"threads_started":1}
W20260808 07:02:32.229169 8849 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:32.224615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:57333 (local address 127.26.23.190:42419)
0808 07:02:32.224679 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:32.224681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:32.224763 (+ 82us) server_negotiation.cc:407] Connection header received
0808 07:02:32.224824 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:32.224825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:32.224840 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:32.224889 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:32.225208 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.225724 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.226451 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.226648 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.226704 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:32.229087 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:57333: BlockingRecv error: recv got EOF from 127.26.23.131:57333 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 07:02:32 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:32 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:32.940058 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:32.935434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:42605)
0808 07:02:32.935584 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:32.935595 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:32.935646 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:32.935784 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:32.935785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:32.935953 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:32.936006 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:32.936007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.936677 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.936679 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:32.937303 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:32.937305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.937733 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.937734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:32.937803 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:32.938264 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:32.938268 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:32.939998 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":65,"threads_started":1}
W20260808 07:02:32.940187 8855 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:32.935465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:42605 (local address 127.26.23.190:42419)
0808 07:02:32.935655 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:32.935657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:32.935666 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:02:32.935691 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:32.935691 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:32.935701 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:32.935769 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:32.936064 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.936568 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.937391 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:32.937641 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:32.937704 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:32.940115 (+ 2411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:42605: BlockingRecv error: recv got EOF from 127.26.23.129:42605 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":64,"threads_started":1}
Aug 08 07:02:33 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:33 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:33.100558 8856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:33.090408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:54877)
0808 07:02:33.090531 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:33.090542 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:33.090602 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:33.090734 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:33.090734 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:33.090902 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:33.090956 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:33.090958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.091599 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.091600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:33.092128 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:33.092130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.092494 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.092496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:33.092544 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:33.098497 (+ 5953us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:33.098502 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:33.100479 (+ 1977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":70,"threads_started":1}
W20260808 07:02:33.100679 8855 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:33.090493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:54877 (local address 127.26.23.190:42419)
0808 07:02:33.090554 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:33.090556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:33.090597 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:02:33.090654 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:33.090654 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:33.090666 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:33.090722 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:33.091003 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.091523 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.092213 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.092421 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.092482 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:33.100620 (+ 8138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:54877: BlockingRecv error: recv got EOF from 127.26.23.130:54877 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 08 07:02:33 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:33 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:33.234300 8859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:33.229516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:51107)
0808 07:02:33.229701 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:33.229713 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:33.229785 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:33.229914 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:33.229915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:33.230105 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:33.230225 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:33.230227 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.230905 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.230907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:33.231459 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:33.231461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.231792 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.231793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:33.231860 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:33.232295 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:33.232299 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:33.234204 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
W20260808 07:02:33.234417 8855 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:33.229623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:51107 (local address 127.26.23.190:42419)
0808 07:02:33.229691 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:33.229694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:33.229765 (+ 71us) server_negotiation.cc:407] Connection header received
0808 07:02:33.229837 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:33.229838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:33.229852 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:33.229900 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:33.230300 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.230829 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.231533 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.231731 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.231784 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:33.234344 (+ 2560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:51107: BlockingRecv error: recv got EOF from 127.26.23.131:51107 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 07:02:33 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:33 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:33.945093 8860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:33.940500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:34899)
0808 07:02:33.940621 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:33.940634 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:33.940699 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:33.940873 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:33.940874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:33.941040 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:33.941092 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:33.941094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.941736 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.941737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:33.942296 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:33.942298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.942686 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.942687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:33.942722 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:33.943169 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:33.943174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:33.945032 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
W20260808 07:02:33.945216 8862 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:33.940581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:34899 (local address 127.26.23.190:42419)
0808 07:02:33.940767 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:33.940769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:33.940776 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:33.940796 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:33.940797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:33.940807 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:33.940862 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:33.941149 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.941678 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.942366 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:33.942580 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:33.942691 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:33.945119 (+ 2428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:34899: BlockingRecv error: recv got EOF from 127.26.23.129:34899 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":125,"threads_started":1}
Aug 08 07:02:34 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:34 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:34.105384 8864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:34.101101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:37405)
0808 07:02:34.101250 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:34.101261 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:34.101323 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:34.101438 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:34.101439 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:34.101613 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:34.101672 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:34.101674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.102333 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.102334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:34.102875 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:34.102877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.103179 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.103180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:34.103216 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:34.103654 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:34.103658 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:34.105323 (+ 1665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":73,"threads_started":1}
W20260808 07:02:34.105480 8862 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:34.101178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:37405 (local address 127.26.23.190:42419)
0808 07:02:34.101252 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:34.101254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:34.101324 (+ 70us) server_negotiation.cc:407] Connection header received
0808 07:02:34.101369 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:34.101370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:34.101382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:34.101425 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:34.101730 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.102279 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.102933 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.103131 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.103177 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:34.105418 (+ 2241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:37405: BlockingRecv error: recv got EOF from 127.26.23.130:37405 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 07:02:34 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:34 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:34.239230 8866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:34.234697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:41851)
0808 07:02:34.234831 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:34.234844 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:34.234914 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:34.235038 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:34.235039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:34.235227 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:34.235278 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:34.235280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.235952 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.235953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:34.236491 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:34.236493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.236929 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.236930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:34.236996 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:34.237426 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:34.237431 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:34.239170 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
W20260808 07:02:34.239347 8862 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:34.234813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:41851 (local address 127.26.23.190:42419)
0808 07:02:34.234867 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:34.234869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:34.234895 (+ 26us) server_negotiation.cc:407] Connection header received
0808 07:02:34.234963 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:34.234964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:34.234977 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:34.235022 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:34.235347 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.235868 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.236587 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.236850 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.236919 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:34.239266 (+ 2347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:41851: BlockingRecv error: recv got EOF from 127.26.23.131:41851 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 07:02:34 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:34 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:34.950090 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:34.945552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:39603)
0808 07:02:34.945695 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:34.945709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:34.945773 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:34.945902 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:34.945903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:34.946077 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:34.946136 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:34.946137 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.946771 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.946771 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:34.947312 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:34.947313 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.947761 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.947762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:34.947809 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:34.948264 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:34.948270 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:34.950015 (+ 1745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
W20260808 07:02:34.950258 8871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:34.945604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:39603 (local address 127.26.23.190:42419)
0808 07:02:34.945771 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:34.945773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:34.945783 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:34.945823 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:34.945823 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:34.945835 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:34.945892 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:34.946207 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.946715 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.947429 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:34.947690 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:34.947756 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:34.950173 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:39603: BlockingRecv error: recv got EOF from 127.26.23.129:39603 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":105,"threads_started":1}
Aug 08 07:02:35 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:35 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:35.110440 8872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:35.105833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:34997)
0808 07:02:35.105958 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:35.105969 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:35.106042 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:35.106204 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:35.106205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:35.106410 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:35.106461 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:35.106463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.107086 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.107087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:35.107629 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:35.107631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.108004 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.108005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:35.108063 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:35.108469 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:35.108475 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:35.110366 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
W20260808 07:02:35.110526 8871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:35.105901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:34997 (local address 127.26.23.190:42419)
0808 07:02:35.105980 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:35.105982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:35.106028 (+ 46us) server_negotiation.cc:407] Connection header received
0808 07:02:35.106091 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:35.106092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:35.106104 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:35.106200 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:35.106523 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.107028 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.107702 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.107915 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.107969 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:35.110464 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:34997: BlockingRecv error: recv got EOF from 127.26.23.130:34997 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 07:02:35 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:35 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:35.244462 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:35.239675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:37403)
0808 07:02:35.239817 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:35.239828 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:35.239895 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:35.240019 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:35.240020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:35.240203 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:35.240253 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:35.240255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.240958 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.240959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:35.241537 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:35.241539 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.241943 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.241945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:35.242016 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:35.242489 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:35.242493 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:35.244370 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":62,"threads_started":1}
W20260808 07:02:35.244522 8871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:35.239765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:37403 (local address 127.26.23.190:42419)
0808 07:02:35.239842 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:35.239844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:35.239885 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:02:35.239940 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:35.239940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:35.239953 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:35.240000 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:35.240302 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.240885 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.241627 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.241855 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.241918 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:35.244468 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:37403: BlockingRecv error: recv got EOF from 127.26.23.131:37403 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 07:02:35 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:35 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:35.954939 8880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:35.950535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:56513)
0808 07:02:35.950692 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:35.950702 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:35.950753 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:35.950872 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:35.950872 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:35.951043 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:35.951092 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:35.951094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.951743 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.951744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:35.952284 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:35.952286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.952644 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.952645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:35.952682 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:35.953137 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:35.953142 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:35.954861 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
W20260808 07:02:35.955021 8881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:35.950607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:56513 (local address 127.26.23.190:42419)
0808 07:02:35.950735 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:35.950736 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:35.950746 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:35.950796 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:35.950796 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:35.950806 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:35.950867 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:35.951164 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.951686 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.952372 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:35.952580 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:35.952644 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:35.954957 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:56513: BlockingRecv error: recv got EOF from 127.26.23.129:56513 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
Aug 08 07:02:36 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:36 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:36.115347 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:36.110915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:55131)
0808 07:02:36.111050 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:36.111061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:36.111124 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:36.111228 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:36.111229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:36.111403 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:36.111462 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:36.111464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.112094 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.112095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:36.112654 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:36.112655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.112955 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.112956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:36.113002 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:36.113437 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:36.113442 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:36.115286 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
W20260808 07:02:36.115442 8881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:36.111008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:55131 (local address 127.26.23.190:42419)
0808 07:02:36.111054 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:36.111056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:36.111119 (+ 63us) server_negotiation.cc:407] Connection header received
0808 07:02:36.111173 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:36.111173 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:36.111185 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:36.111221 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:36.111510 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.112020 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.112719 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.112898 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.112939 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:36.115381 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:55131: BlockingRecv error: recv got EOF from 127.26.23.130:55131 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 07:02:36 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:36 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:36.249596 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:36.244928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:44109)
0808 07:02:36.245098 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:36.245109 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:36.245178 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:36.245382 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:36.245383 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:36.245644 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:36.245712 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:36.245715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.246426 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.246427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:36.246985 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:36.246986 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.247360 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.247361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:36.247421 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:36.247826 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:36.247831 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:36.249532 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
W20260808 07:02:36.249713 8881 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:36.245025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:44109 (local address 127.26.23.190:42419)
0808 07:02:36.245093 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:36.245096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:36.245172 (+ 76us) server_negotiation.cc:407] Connection header received
0808 07:02:36.245260 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:36.245262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:36.245277 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:36.245340 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:36.245820 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.246357 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.247058 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.247259 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.247314 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:36.249639 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:44109: BlockingRecv error: recv got EOF from 127.26.23.131:44109 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 07:02:36 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:36 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:36.960165 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:36.955397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:49815)
0808 07:02:36.955535 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:36.955562 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:36.955620 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:36.955783 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:36.955784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:36.955958 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:36.956011 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:36.956012 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.956725 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.956727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:36.957285 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:36.957287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.957647 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.957648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:36.957724 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:36.958217 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:36.958225 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:36.960103 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
W20260808 07:02:36.960268 8886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:36.955496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:49815 (local address 127.26.23.190:42419)
0808 07:02:36.955666 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:36.955668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:36.955675 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:02:36.955697 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:36.955698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:36.955710 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:36.955773 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:36.956079 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.956653 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.957363 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:36.957583 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:36.957637 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:36.960196 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:49815: BlockingRecv error: recv got EOF from 127.26.23.129:49815 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":106,"threads_started":1}
Aug 08 07:02:37 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:37 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:37.120335 8891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:37.115800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:41827)
0808 07:02:37.115930 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:37.115941 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:37.116005 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:37.116177 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:37.116178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:37.116355 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:37.116405 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:37.116407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.117120 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.117129 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:37.117716 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:37.117719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.118141 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.118142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:37.118236 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:37.118619 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:37.118648 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:37.120275 (+ 1627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
W20260808 07:02:37.120438 8886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:37.115924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:41827 (local address 127.26.23.190:42419)
0808 07:02:37.115995 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:37.115997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:37.116007 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:37.116060 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:37.116061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:37.116074 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:37.116121 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:37.116477 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.117035 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.117792 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.118073 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.118142 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:37.120370 (+ 2228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:41827: BlockingRecv error: recv got EOF from 127.26.23.130:41827 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 07:02:37 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:37 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:37.254532 8893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:37.250047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:38881)
0808 07:02:37.250219 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:37.250233 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:37.250305 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:37.250429 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:37.250430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:37.250621 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:37.250670 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:37.250672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.251327 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.251328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:37.251901 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:37.251903 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.252240 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.252241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:37.252300 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:37.252716 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:37.252720 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:37.254453 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":120,"threads_started":1}
W20260808 07:02:37.254608 8886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:37.250134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38881 (local address 127.26.23.190:42419)
0808 07:02:37.250238 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:37.250240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:37.250291 (+ 51us) server_negotiation.cc:407] Connection header received
0808 07:02:37.250360 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:37.250361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:37.250376 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:37.250423 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:37.250737 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.251255 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.251978 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.252178 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.252234 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:37.254553 (+ 2319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:38881: BlockingRecv error: recv got EOF from 127.26.23.131:38881 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 07:02:37 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:37 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:37.965262 8894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:37.960589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:35825)
0808 07:02:37.960725 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:37.960735 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:37.960785 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:37.960909 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:37.960910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:37.961084 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:37.961140 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:37.961142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.961826 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.961827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:37.962404 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:37.962406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.962791 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.962792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:37.962846 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:37.963402 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:37.963407 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:37.965191 (+ 1784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
W20260808 07:02:37.965354 8895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:37.960677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:35825 (local address 127.26.23.190:42419)
0808 07:02:37.960792 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:37.960794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:37.960802 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:37.960825 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:37.960826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:37.960837 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:37.960900 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:37.961208 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.961764 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.962472 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:37.962693 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:37.962779 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:37.965286 (+ 2507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:35825: BlockingRecv error: recv got EOF from 127.26.23.129:35825 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
Aug 08 07:02:38 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:38 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:38.128239 8896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:38.120808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:32961)
0808 07:02:38.120964 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:38.120975 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:38.121040 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:38.121171 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:38.121171 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:38.121350 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:38.121402 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:38.121403 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.122013 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.122014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:38.122665 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:38.122668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.123116 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.123118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:38.123188 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:38.126425 (+ 3237us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:38.126430 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:38.128162 (+ 1732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
W20260808 07:02:38.128332 8895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:38.120899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:32961 (local address 127.26.23.190:42419)
0808 07:02:38.120977 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:38.120979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:38.121032 (+ 53us) server_negotiation.cc:407] Connection header received
0808 07:02:38.121100 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:38.121101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:38.121113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:38.121154 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:38.121459 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.121956 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.122742 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.123044 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.123114 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:38.128268 (+ 5154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:32961: BlockingRecv error: recv got EOF from 127.26.23.130:32961 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 08 07:02:38 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:38 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.131@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:38.259701 8901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:38.254989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.131:41219)
0808 07:02:38.255174 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:38.255183 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:38.255249 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:38.255375 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:38.255376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:38.255557 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:38.255608 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:38.255610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.256279 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.256280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:38.256901 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:38.256904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.257234 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.257235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:38.257296 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:38.257806 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:38.257811 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:38.259608 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":124,"threads_started":1}
W20260808 07:02:38.259779 8895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:38.255053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:41219 (local address 127.26.23.190:42419)
0808 07:02:38.255104 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:38.255107 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:38.255239 (+ 132us) server_negotiation.cc:407] Connection header received
0808 07:02:38.255299 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:38.255300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:38.255314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:38.255368 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:38.255692 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.256200 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.256978 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.257173 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.257228 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:38.259725 (+ 2497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.131:41219: BlockingRecv error: recv got EOF from 127.26.23.131:41219 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 07:02:38 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:38 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.129@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:38.970566 8902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:38.965809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.129:39389)
0808 07:02:38.965955 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:38.965966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:38.966026 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:38.966179 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:38.966180 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:38.966348 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:38.966404 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:38.966405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.967042 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.967043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:38.967584 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:38.967586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.967954 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.967956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:38.968025 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:38.968586 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:38.968592 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:38.970462 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
W20260808 07:02:38.970614 8903 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:38.965900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:39389 (local address 127.26.23.190:42419)
0808 07:02:38.966045 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:38.966047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:38.966055 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:38.966076 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:38.966077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:38.966088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:38.966175 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:38.966458 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.966960 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.967646 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:38.967884 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:38.967940 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:38.970558 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.129:39389: BlockingRecv error: recv got EOF from 127.26.23.129:39389 (error 108)
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
Aug 08 07:02:39 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
Aug 08 07:02:39 dist-test-slave-zj8q krb5kdc[7198](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.26.23.130@KRBTEST.COM for oryx/127.26.23.190@KRBTEST.COM, Server not found in Kerberos database
I20260808 07:02:39.133167 8905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.128725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42419 (local address 127.26.23.130:39791)
0808 07:02:39.128863 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:39.128876 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:39.128948 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:39.129078 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:39.129079 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:39.129273 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:39.129325 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.129327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.129983 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.129984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.130551 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.130554 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.130884 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.130885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.130942 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.131354 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:39.131358 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:39.133097 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.26.23.190:42419: Server oryx/127.26.23.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
W20260808 07:02:39.133263 8903 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:39.128828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:39791 (local address 127.26.23.190:42419)
0808 07:02:39.128896 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.128898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.128927 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:02:39.129005 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.129006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.129018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.129067 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.129396 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.129908 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.130631 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.130822 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.130879 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.133197 (+ 2318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.26.23.130:39791: BlockingRecv error: recv got EOF from 127.26.23.130:39791 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:02:39.180636 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 8111
I20260808 07:02:39.192330 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 8363
I20260808 07:02:39.210772 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 8580
I20260808 07:02:39.220264 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 7998
2026-08-08T07:02:39Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17580 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T07:02:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:39Z Disabled control of system clock
I20260808 07:02:39.251783 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33441
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:33441
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 07:02:39.331540 8911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:39.331748 8911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:39.331777 8911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:39.332906 8911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:39.332947 8911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:39.332963 8911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:39.332979 8911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:39.332994 8911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:39.334329 8911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:33441
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:39.334558 8911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:39.334829 8911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:39.339675 8918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.339684 8919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.339959 8911 server_base.cc:1034] running on GCE node
W20260808 07:02:39.339831 8921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.340265 8911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:39.340531 8911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:39.341693 8911 hybrid_clock.cc:648] HybridClock initialized: now 1786172559341682 us; error 30 us; skew 500 ppm
I20260808 07:02:39.342890 8911 webserver.cc:460] Webserver started at http://127.26.23.190:36183/ using document root <none> and password file <none>
I20260808 07:02:39.343113 8911 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:39.343166 8911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:39.343295 8911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:39.344383 8911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "7766c47d4a6380db004b2e3dc4144ef3"
server_key_iv: "2af65ca832abf7cf4ff1f3c575ea3cc2"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.344707 8911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "7766c47d4a6380db004b2e3dc4144ef3"
server_key_iv: "2af65ca832abf7cf4ff1f3c575ea3cc2"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.345877 8911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:02:39.346567 8927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.346727 8911 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.346810 8911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "7766c47d4a6380db004b2e3dc4144ef3"
server_key_iv: "2af65ca832abf7cf4ff1f3c575ea3cc2"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.346874 8911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:39.367218 8911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:39.367492 8911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:39.367637 8911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:39.371589 8911 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:33441
I20260808 07:02:39.371636 9016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:33441 every 8 connection(s)
I20260808 07:02:39.371960 8911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:39.372611 9017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:39.375219 9017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d: Bootstrap starting.
I20260808 07:02:39.375788 9017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:39.376046 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 8911
I20260808 07:02:39.376058 9017 log.cc:824] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:39.376121 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:39.376305 26718 external_mini_cluster.cc:1428] Setting key 5d4cee576049aaf12a610417ee3e64d9
I20260808 07:02:39.376863 9017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d: No bootstrap required, opened a new log
I20260808 07:02:39.378569 9017 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33441 } }
I20260808 07:02:39.378705 9017 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:39.378738 9017 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf8fba866a94bfeb6dbe5ddf8a4ea4d, State: Initialized, Role: FOLLOWER
I20260808 07:02:39.378895 9017 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33441 } }
I20260808 07:02:39.378993 9017 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:39.379024 9017 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:39.379073 9017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:39.379848 9017 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33441 } }
I20260808 07:02:39.379937 9017 leader_election.cc:302] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbf8fba866a94bfeb6dbe5ddf8a4ea4d; no voters:
I20260808 07:02:39.380113 9017 leader_election.cc:288] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:39.380172 9028 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:39.380362 9017 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:39.380383 9028 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [term 1 LEADER]: Becoming Leader. State: Replica: dbf8fba866a94bfeb6dbe5ddf8a4ea4d, State: Running, Role: LEADER
I20260808 07:02:39.380623 9028 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33441 } }
I20260808 07:02:39.380972 9033 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbf8fba866a94bfeb6dbe5ddf8a4ea4d. Latest consensus state: current_term: 1 leader_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33441 } } }
I20260808 07:02:39.381060 9033 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:39.380986 9030 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf8fba866a94bfeb6dbe5ddf8a4ea4d" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33441 } } }
I20260808 07:02:39.381273 9044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:39.381290 9030 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:39.381757 9044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:39.383572 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.376786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45814 (local address 127.26.23.190:33441)
0808 07:02:39.376975 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.376984 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.377008 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:02:39.378543 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.378551 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.378615 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.378738 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.378969 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.379925 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.381008 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.381613 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.381706 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.382819 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:39.382823 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:39.382823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:39.383016 (+ 193us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:39.383061 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:39.383076 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:39.383117 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:39.383252 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 07:02:39.383343 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260808 07:02:39.384147 9044 catalog_manager.cc:1347] Generated new cluster ID: 8ebb8e946f614426be4846ab80aa7575
I20260808 07:02:39.384248 9044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:39.394856 9044 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:39.395349 9044 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:39.401502 9044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbf8fba866a94bfeb6dbe5ddf8a4ea4d: Generated new TSK 0
I20260808 07:02:39.401643 9044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:02:39.405118 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33441
--builtin_ntp_servers=127.26.23.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 07:02:39.488114 9059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:39.488308 9059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:39.488328 9059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:39.489427 9059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:39.489467 9059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:39.489491 9059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:39.490881 9059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:39.491111 9059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:39.491385 9059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:39.497176 9067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.497231 9064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.497471 9059 server_base.cc:1034] running on GCE node
W20260808 07:02:39.497227 9065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.497761 9059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:39.497994 9059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:39.499164 9059 hybrid_clock.cc:648] HybridClock initialized: now 1786172559499133 us; error 46 us; skew 500 ppm
I20260808 07:02:39.500391 9059 webserver.cc:460] Webserver started at http://127.26.23.129:38335/ using document root <none> and password file <none>
I20260808 07:02:39.500669 9059 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:39.500716 9059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:39.500849 9059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:39.501921 9059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "6723edfa057442f0a8291074dc04bae7"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "1279e24caf2ea0ed104c35af08036873"
server_key_iv: "493fa998cdee6376a2a49e13df4a0619"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.502317 9059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "6723edfa057442f0a8291074dc04bae7"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "1279e24caf2ea0ed104c35af08036873"
server_key_iv: "493fa998cdee6376a2a49e13df4a0619"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.503624 9059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:39.504362 9075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.504515 9059 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:39.504602 9059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "6723edfa057442f0a8291074dc04bae7"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "1279e24caf2ea0ed104c35af08036873"
server_key_iv: "493fa998cdee6376a2a49e13df4a0619"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.504671 9059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:39.527699 9059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:39.527998 9059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:39.528136 9059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:39.528362 9059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:39.528690 9059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:39.528723 9059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.528753 9059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:39.528771 9059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.534302 9059 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:34687
I20260808 07:02:39.534379 9260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:34687 every 8 connection(s)
I20260808 07:02:39.534660 9059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:02:39.539546 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.535354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:45163 (local address 127.26.23.190:33441)
0808 07:02:39.535422 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.535424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.535649 (+ 225us) server_negotiation.cc:407] Connection header received
0808 07:02:39.536200 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.536201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.536214 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.536272 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.536906 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.537408 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.538369 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.538555 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.538602 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.539335 (+ 733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:39.539336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:39.539336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:39.539340 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:39.539355 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:39.539359 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:39.539401 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:39.539463 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 07:02:39.539487 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:02:39.539718 9267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.535339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33441 (local address 127.26.23.129:45163)
0808 07:02:39.535528 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:39.535562 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:39.536085 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:39.536327 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:39.536330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:39.536338 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:39.536826 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.536830 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.537474 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.537475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.538304 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.538307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.538608 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.538609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.538715 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.539207 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:39.539207 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:39.539235 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:39.539257 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:39.539407 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:39.539409 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:39.539412 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:39.539457 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:39.539536 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":90,"threads_started":1}
I20260808 07:02:39.540181 9262 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33441
I20260808 07:02:39.540263 9262 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:39.540413 9262 heartbeater.cc:511] Master 127.26.23.190:33441 requested a full tablet report, sending...
I20260808 07:02:39.540899 8954 ts_manager.cc:194] Registered new tserver with Master: 6723edfa057442f0a8291074dc04bae7 (127.26.23.129:34687)
I20260808 07:02:39.541178 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 9059
I20260808 07:02:39.541253 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:39.541433 26718 external_mini_cluster.cc:1428] Setting key 3853c86685048ac73a661f8522294259
I20260808 07:02:39.541540 8954 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.129:45163
I20260808 07:02:39.542338 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33441
--builtin_ntp_servers=127.26.23.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 07:02:39.623873 9269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:39.624064 9269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:39.624083 9269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:39.625151 9269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:39.625185 9269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:39.625211 9269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:39.626530 9269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:39.626714 9269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:39.626951 9269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:39.631763 9279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.631803 9269 server_base.cc:1034] running on GCE node
W20260808 07:02:39.631822 9276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.631771 9277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.632212 9269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:39.632411 9269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:39.633538 9269 hybrid_clock.cc:648] HybridClock initialized: now 1786172559633526 us; error 28 us; skew 500 ppm
I20260808 07:02:39.634737 9269 webserver.cc:460] Webserver started at http://127.26.23.130:39023/ using document root <none> and password file <none>
I20260808 07:02:39.634935 9269 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:39.634984 9269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:39.635110 9269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:39.636127 9269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "528e92ea703143dd9d71e16a58b03d6a"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "cd77bbe461f015bbcfd04146da3c87c1"
server_key_iv: "6d120edffe33def2c515eeb5a32a56d0"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.636454 9269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "528e92ea703143dd9d71e16a58b03d6a"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "cd77bbe461f015bbcfd04146da3c87c1"
server_key_iv: "6d120edffe33def2c515eeb5a32a56d0"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.637712 9269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:39.638450 9286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.638605 9269 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:39.638726 9269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "528e92ea703143dd9d71e16a58b03d6a"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "cd77bbe461f015bbcfd04146da3c87c1"
server_key_iv: "6d120edffe33def2c515eeb5a32a56d0"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.638787 9269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:39.669605 9269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:39.669935 9269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:39.670068 9269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:39.670332 9269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:39.670703 9269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:39.670755 9269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.670786 9269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:39.670802 9269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.676314 9269 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:43641
I20260808 07:02:39.676371 9462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:43641 every 8 connection(s)
I20260808 07:02:39.676697 9269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:39.677964 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 9269
I20260808 07:02:39.678064 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:39.678306 26718 external_mini_cluster.cc:1428] Setting key e75d91ce4bda3f91e5fa6b6cf016adeb
I20260808 07:02:39.679337 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33441
--builtin_ntp_servers=127.26.23.148:45429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 07:02:39.682928 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.677414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:39793 (local address 127.26.23.190:33441)
0808 07:02:39.677479 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.677481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.677714 (+ 233us) server_negotiation.cc:407] Connection header received
0808 07:02:39.678441 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.678442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.678453 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.678511 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.679347 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.679949 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.681379 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.681699 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.681762 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.682656 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:39.682658 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:39.682658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:39.682663 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:39.682677 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:39.682681 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:39.682719 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:39.682835 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 07:02:39.682863 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:02:39.683138 9466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.677387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33441 (local address 127.26.23.130:39793)
0808 07:02:39.677586 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:39.677630 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:39.678333 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:39.678585 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:39.678590 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:39.678601 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:39.679250 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.679258 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.680089 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.680091 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.681315 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.681319 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.681785 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.681785 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.681904 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.682491 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:39.682492 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:39.682531 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:39.682559 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:39.682729 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:39.682734 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:39.682737 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:39.682799 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:02:39.682908 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260808 07:02:39.683625 9464 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33441
I20260808 07:02:39.683709 9464 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:39.683889 9464 heartbeater.cc:511] Master 127.26.23.190:33441 requested a full tablet report, sending...
I20260808 07:02:39.684242 8954 ts_manager.cc:194] Registered new tserver with Master: 528e92ea703143dd9d71e16a58b03d6a (127.26.23.130:43641)
I20260808 07:02:39.684574 8954 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.130:39793
W20260808 07:02:39.762187 9467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:39.762387 9467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:39.762416 9467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:39.763535 9467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:39.763583 9467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:39.763618 9467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:39.764925 9467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:39.765162 9467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:39.765441 9467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:39.770596 9487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.770658 9476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.770699 9478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.770750 9467 server_base.cc:1034] running on GCE node
I20260808 07:02:39.771098 9467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:39.771307 9467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:39.772464 9467 hybrid_clock.cc:648] HybridClock initialized: now 1786172559772449 us; error 31 us; skew 500 ppm
I20260808 07:02:39.773733 9467 webserver.cc:460] Webserver started at http://127.26.23.131:36885/ using document root <none> and password file <none>
I20260808 07:02:39.773942 9467 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:39.773986 9467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:39.774111 9467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:39.775164 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "99c0fde275624d0895067fb5130ddadb"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "0de56a0568db02a903af41d8ae06bb9f"
server_key_iv: "aaa39b450410c4ac97659c2a6c22db29"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.775522 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "99c0fde275624d0895067fb5130ddadb"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "0de56a0568db02a903af41d8ae06bb9f"
server_key_iv: "aaa39b450410c4ac97659c2a6c22db29"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.776748 9467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:02:39.777390 9497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.777537 9467 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:02:39.777657 9467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "99c0fde275624d0895067fb5130ddadb"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "0de56a0568db02a903af41d8ae06bb9f"
server_key_iv: "aaa39b450410c4ac97659c2a6c22db29"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.777724 9467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:39.793468 9467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:39.793752 9467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:39.793874 9467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:39.794076 9467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:39.794409 9467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:39.794442 9467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.794469 9467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:39.794486 9467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.799857 9467 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:39891
I20260808 07:02:39.799922 9698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:39891 every 8 connection(s)
I20260808 07:02:39.800205 9467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:39.805083 9026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.800869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:34843 (local address 127.26.23.190:33441)
0808 07:02:39.800930 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.800932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.801161 (+ 229us) server_negotiation.cc:407] Connection header received
0808 07:02:39.801616 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.801617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.801628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.801673 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.802366 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.802864 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.803816 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.803991 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.804035 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.804868 (+ 833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:39.804870 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:39.804870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:39.804874 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:39.804888 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:39.804892 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:39.804948 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:39.804996 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 07:02:39.805021 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:02:39.805258 9702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.800835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33441 (local address 127.26.23.131:34843)
0808 07:02:39.801021 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:39.801059 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:39.801538 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:39.801738 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:39.801742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:39.801750 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:39.802286 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.802292 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.802933 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.802934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.803755 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:39.803758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:39.804045 (+ 287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:39.804045 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:39.804145 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:39.804663 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:39.804663 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:39.804691 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:39.804713 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:39.804952 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:39.804954 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:39.804956 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:39.804997 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 07:02:39.805077 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260808 07:02:39.805682 9699 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33441
I20260808 07:02:39.805773 9699 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:39.805929 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 9467
I20260808 07:02:39.805967 9699 heartbeater.cc:511] Master 127.26.23.190:33441 requested a full tablet report, sending...
I20260808 07:02:39.806015 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:39.806277 26718 external_mini_cluster.cc:1428] Setting key 27cf402f42f1288329856bf2842c91b5
I20260808 07:02:39.806340 8954 ts_manager.cc:194] Registered new tserver with Master: 99c0fde275624d0895067fb5130ddadb (127.26.23.131:39891)
I20260808 07:02:39.806833 8954 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.131:34843
I20260808 07:02:39.807153 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:02:39.808825 9026 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:39.808401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45824 (local address 127.26.23.190:33441)
0808 07:02:39.808464 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.808466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.808569 (+ 103us) server_negotiation.cc:407] Connection header received
0808 07:02:39.808594 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.808595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.808606 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.808658 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.808767 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45824: BlockingRecv error: recv got EOF from 127.0.0.1:45824 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:02:39.808872 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 9059
I20260808 07:02:39.830807 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 9269
I20260808 07:02:39.839041 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 9467
I20260808 07:02:39.851434 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 8911
2026-08-08T07:02:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (631 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T07:02:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:39Z Disabled control of system clock
I20260808 07:02:39.882761 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40197
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:43389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:40197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:02:39.962996 9719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:39.963205 9719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:39.963227 9719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:39.964327 9719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:39.964368 9719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:39.964380 9719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:39.964392 9719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:39.964416 9719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:39.965837 9719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:40197
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:39.966076 9719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:39.966373 9719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:39.971030 9733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.971060 9730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:39.971058 9729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:39.971094 9719 server_base.cc:1034] running on GCE node
I20260808 07:02:39.971473 9719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:39.971750 9719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:39.972924 9719 hybrid_clock.cc:648] HybridClock initialized: now 1786172559972905 us; error 29 us; skew 500 ppm
I20260808 07:02:39.974198 9719 webserver.cc:460] Webserver started at http://127.26.23.190:44691/ using document root <none> and password file <none>
I20260808 07:02:39.974423 9719 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:39.974472 9719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:39.974663 9719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:39.975713 9719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "60e5670595174eed884c1bc08f6e738a"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "a0ab44402df7d812414ce132f9e7489a"
server_key_iv: "039eebe2dc70dd046f509c1ec1b8e8ea"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.976085 9719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "60e5670595174eed884c1bc08f6e738a"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "a0ab44402df7d812414ce132f9e7489a"
server_key_iv: "039eebe2dc70dd046f509c1ec1b8e8ea"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.977289 9719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:02:39.977973 9743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:39.978123 9719 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:39.978232 9719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "60e5670595174eed884c1bc08f6e738a"
format_stamp: "Formatted at 2026-08-08 07:02:39 on dist-test-slave-zj8q"
server_key: "a0ab44402df7d812414ce132f9e7489a"
server_key_iv: "039eebe2dc70dd046f509c1ec1b8e8ea"
server_key_version: "encryptionkey@0"
I20260808 07:02:39.978296 9719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:39.981496 9719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:39.981748 9719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:39.981865 9719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:39.985595 9719 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:40197
I20260808 07:02:39.985646 9814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:40197 every 8 connection(s)
I20260808 07:02:39.985925 9719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:39.986572 9816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:39.986771 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 9719
I20260808 07:02:39.986863 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:39.987035 26718 external_mini_cluster.cc:1428] Setting key 8a816e6a07ddf2386b66cb18d3cd62b0
I20260808 07:02:39.989598 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:39.987617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46996 (local address 127.26.23.190:40197)
0808 07:02:39.987812 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:39.987819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:39.987842 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:02:39.988380 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:39.988386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:39.988428 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:39.988553 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:39.989217 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:39.989221 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:39.989221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:39.989225 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:39.989267 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:39.989277 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:39.989330 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:39.989401 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 07:02:39.989456 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260808 07:02:39.989948 9816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a: Bootstrap starting.
I20260808 07:02:39.990587 9816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:39.990845 9816 log.cc:824] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:39.991461 9816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a: No bootstrap required, opened a new log
I20260808 07:02:39.992760 9816 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e5670595174eed884c1bc08f6e738a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40197 } }
I20260808 07:02:39.992889 9816 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:39.992921 9816 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e5670595174eed884c1bc08f6e738a, State: Initialized, Role: FOLLOWER
I20260808 07:02:39.993031 9816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e5670595174eed884c1bc08f6e738a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40197 } }
I20260808 07:02:39.993090 9816 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:39.993119 9816 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:39.993165 9816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:39.993671 9816 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e5670595174eed884c1bc08f6e738a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40197 } }
I20260808 07:02:39.993767 9816 leader_election.cc:302] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60e5670595174eed884c1bc08f6e738a; no voters:
I20260808 07:02:39.993911 9816 leader_election.cc:288] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:39.994174 9816 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:39.994213 9824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:39.994369 9824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [term 1 LEADER]: Becoming Leader. State: Replica: 60e5670595174eed884c1bc08f6e738a, State: Running, Role: LEADER
I20260808 07:02:39.994468 9824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e5670595174eed884c1bc08f6e738a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40197 } }
I20260808 07:02:39.994813 9825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60e5670595174eed884c1bc08f6e738a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e5670595174eed884c1bc08f6e738a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40197 } } }
I20260808 07:02:39.994815 9826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60e5670595174eed884c1bc08f6e738a. Latest consensus state: current_term: 1 leader_uuid: "60e5670595174eed884c1bc08f6e738a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60e5670595174eed884c1bc08f6e738a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40197 } } }
I20260808 07:02:39.994946 9825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:39.994951 9826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:39.995155 9839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:39.995680 9839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:39.997098 9839 catalog_manager.cc:1347] Generated new cluster ID: 4f6bb70a5a38487c99584ac769975e3b
I20260808 07:02:39.997150 9839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:02:40.003651 9839 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:40.003803 9839 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:40.013792 9839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60e5670595174eed884c1bc08f6e738a: Generated new TSK 0
I20260808 07:02:40.014002 9839 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:02:40.019634 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40197
--builtin_ntp_servers=127.26.23.148:43389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:02:40.101186 9854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:40.101388 9854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:40.101410 9854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:40.102581 9854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:40.102620 9854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:40.102645 9854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:40.103950 9854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:40.104188 9854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:40.104466 9854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:40.110222 9862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:40.110276 9863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:40.110283 9865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:40.110507 9854 server_base.cc:1034] running on GCE node
I20260808 07:02:40.110685 9854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:40.110903 9854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:40.112044 9854 hybrid_clock.cc:648] HybridClock initialized: now 1786172560112032 us; error 31 us; skew 500 ppm
I20260808 07:02:40.113327 9854 webserver.cc:460] Webserver started at http://127.26.23.129:39371/ using document root <none> and password file <none>
I20260808 07:02:40.113539 9854 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:40.113602 9854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:40.113735 9854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:40.114835 9854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "3d7aa1761a544823b49d4745f21dbea2"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "822fc1b815e75ac872604b39e01a58fb"
server_key_iv: "49954dea6c36267b180cc92209e66ef4"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.115191 9854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "3d7aa1761a544823b49d4745f21dbea2"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "822fc1b815e75ac872604b39e01a58fb"
server_key_iv: "49954dea6c36267b180cc92209e66ef4"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.116400 9854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:40.117085 9876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.117340 9854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:02:40.117445 9854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "3d7aa1761a544823b49d4745f21dbea2"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "822fc1b815e75ac872604b39e01a58fb"
server_key_iv: "49954dea6c36267b180cc92209e66ef4"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.117515 9854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:40.121927 9854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:40.122221 9854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:40.122341 9854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:40.122576 9854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:40.122928 9854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:40.122980 9854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.123006 9854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:40.123023 9854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.129263 9854 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:37371
I20260808 07:02:40.129335 10065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:37371 every 8 connection(s)
I20260808 07:02:40.129612 9854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:02:40.132416 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:40.130405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:45751 (local address 127.26.23.190:40197)
0808 07:02:40.130449 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:40.130451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:40.130623 (+ 172us) server_negotiation.cc:407] Connection header received
0808 07:02:40.131064 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:40.131065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:40.131070 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:40.131137 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:40.132231 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:40.132233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:40.132233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:40.132237 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:40.132252 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:40.132256 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:40.132303 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:40.132350 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 07:02:40.132362 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:02:40.132573 10069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:40.130313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40197 (local address 127.26.23.129:45751)
0808 07:02:40.130500 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:40.130540 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:40.130987 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:40.131193 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:40.131196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:40.131204 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:40.132076 (+ 872us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:40.132077 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:40.132105 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:40.132142 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:40.132302 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:40.132304 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:40.132306 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:02:40.132350 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:02:40.132395 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260808 07:02:40.133020 10066 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40197
I20260808 07:02:40.133107 10066 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:40.133247 10066 heartbeater.cc:511] Master 127.26.23.190:40197 requested a full tablet report, sending...
I20260808 07:02:40.133701 9762 ts_manager.cc:194] Registered new tserver with Master: 3d7aa1761a544823b49d4745f21dbea2 (127.26.23.129:37371)
I20260808 07:02:40.135177 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 9854
I20260808 07:02:40.135257 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:40.135439 26718 external_mini_cluster.cc:1428] Setting key a805eb923fcd70e2584a6113ca3072d1
I20260808 07:02:40.136261 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40197
--builtin_ntp_servers=127.26.23.148:43389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:02:40.217200 10070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:40.217392 10070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:40.217412 10070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:40.218533 10070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:40.218581 10070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:40.218606 10070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:40.219909 10070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:40.220130 10070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:40.220405 10070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:40.225206 10078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:40.225212 10086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:40.225404 10070 server_base.cc:1034] running on GCE node
W20260808 07:02:40.225222 10079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:40.225759 10070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:40.225982 10070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:40.227162 10070 hybrid_clock.cc:648] HybridClock initialized: now 1786172560227138 us; error 42 us; skew 500 ppm
I20260808 07:02:40.228488 10070 webserver.cc:460] Webserver started at http://127.26.23.130:36971/ using document root <none> and password file <none>
I20260808 07:02:40.228781 10070 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:40.228829 10070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:40.228941 10070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:40.230238 10070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "8672af9072e94d05b79a58f8bd5c3e9f"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "19f41d962aa75944511de3af03bd37f5"
server_key_iv: "bda8e9f84f0d786e30f157a56be2afdf"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.230623 10070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "8672af9072e94d05b79a58f8bd5c3e9f"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "19f41d962aa75944511de3af03bd37f5"
server_key_iv: "bda8e9f84f0d786e30f157a56be2afdf"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.232040 10070 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:02:40.232877 10099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.233067 10070 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:02:40.233166 10070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "8672af9072e94d05b79a58f8bd5c3e9f"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "19f41d962aa75944511de3af03bd37f5"
server_key_iv: "bda8e9f84f0d786e30f157a56be2afdf"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.233230 10070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:40.236493 10070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:40.236732 10070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:40.236848 10070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:40.237023 10070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:40.237299 10070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:40.237332 10070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.237357 10070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:40.237380 10070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.242831 10070 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:43285
I20260808 07:02:40.242889 10292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:43285 every 8 connection(s)
I20260808 07:02:40.243153 10070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:40.245962 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:40.243768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:48097 (local address 127.26.23.190:40197)
0808 07:02:40.243811 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:40.243813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:40.244035 (+ 222us) server_negotiation.cc:407] Connection header received
0808 07:02:40.244520 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:40.244521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:40.244529 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:40.244582 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:40.245721 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:40.245724 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:40.245724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:40.245729 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:40.245746 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:40.245751 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:40.245800 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:40.245875 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:02:40.245889 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:02:40.246140 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:40.243752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40197 (local address 127.26.23.130:48097)
0808 07:02:40.243919 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:40.243951 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:40.244420 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:40.244656 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:40.244660 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:40.244669 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:40.245572 (+ 903us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:40.245573 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:40.245600 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:40.245631 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:40.245803 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:40.245808 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:40.245811 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:40.245882 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 07:02:40.245941 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":70,"threads_started":1}
I20260808 07:02:40.246577 10294 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40197
I20260808 07:02:40.246666 10294 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:40.246805 10294 heartbeater.cc:511] Master 127.26.23.190:40197 requested a full tablet report, sending...
I20260808 07:02:40.247123 9762 ts_manager.cc:194] Registered new tserver with Master: 8672af9072e94d05b79a58f8bd5c3e9f (127.26.23.130:43285)
I20260808 07:02:40.251405 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 10070
I20260808 07:02:40.251487 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:40.251658 26718 external_mini_cluster.cc:1428] Setting key 33de37bc008d736e7b37c98529971ddf
I20260808 07:02:40.252568 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40197
--builtin_ntp_servers=127.26.23.148:43389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 07:02:40.334096 10297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:40.334311 10297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:40.334331 10297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:40.335427 10297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:40.335458 10297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:40.335481 10297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:40.336926 10297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:43389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:40.337121 10297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:40.337352 10297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:02:40.342319 10297 server_base.cc:1034] running on GCE node
W20260808 07:02:40.342294 10304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:40.342324 10310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:40.342303 10303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:40.342768 10297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:40.342988 10297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:40.344121 10297 hybrid_clock.cc:648] HybridClock initialized: now 1786172560344111 us; error 31 us; skew 500 ppm
I20260808 07:02:40.345345 10297 webserver.cc:460] Webserver started at http://127.26.23.131:36205/ using document root <none> and password file <none>
I20260808 07:02:40.345562 10297 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:40.345619 10297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:40.345757 10297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:40.346832 10297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "9f309cce687a4dfc8c41835cdde8b042"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "d338d3f4fedb960e6a005df5322dcbe5"
server_key_iv: "2038de21ca9fc3143eea94ae0b86eb72"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.347158 10297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "9f309cce687a4dfc8c41835cdde8b042"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "d338d3f4fedb960e6a005df5322dcbe5"
server_key_iv: "2038de21ca9fc3143eea94ae0b86eb72"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.348372 10297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:40.349018 10321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.349186 10297 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:40.349272 10297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "9f309cce687a4dfc8c41835cdde8b042"
format_stamp: "Formatted at 2026-08-08 07:02:40 on dist-test-slave-zj8q"
server_key: "d338d3f4fedb960e6a005df5322dcbe5"
server_key_iv: "2038de21ca9fc3143eea94ae0b86eb72"
server_key_version: "encryptionkey@0"
I20260808 07:02:40.349329 10297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:40.352563 10297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:40.352797 10297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:40.352912 10297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:40.353098 10297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:40.353396 10297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:40.353430 10297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.353456 10297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:40.353480 10297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:40.358968 10297 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:45195
I20260808 07:02:40.359007 10491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:45195 every 8 connection(s)
I20260808 07:02:40.359284 10297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:02:40.361936 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:40.359959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:47347 (local address 127.26.23.190:40197)
0808 07:02:40.360021 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:40.360023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:40.360208 (+ 185us) server_negotiation.cc:407] Connection header received
0808 07:02:40.360692 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:40.360694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:40.360700 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:40.360750 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:40.361754 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:40.361756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:40.361756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:02:40.361760 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:40.361774 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:02:40.361777 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:40.361816 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:40.361871 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 07:02:40.361882 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:02:40.362094 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:40.359934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40197 (local address 127.26.23.131:47347)
0808 07:02:40.360099 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:40.360130 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:40.360605 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:40.360801 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:40.360805 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:40.360813 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:40.361629 (+ 816us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:02:40.361630 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:40.361657 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:02:40.361683 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:40.361821 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:40.361823 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:40.361826 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:40.361872 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:02:40.361915 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260808 07:02:40.362509 10492 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40197
I20260808 07:02:40.362598 10492 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:40.362735 10492 heartbeater.cc:511] Master 127.26.23.190:40197 requested a full tablet report, sending...
I20260808 07:02:40.363036 9762 ts_manager.cc:194] Registered new tserver with Master: 9f309cce687a4dfc8c41835cdde8b042 (127.26.23.131:45195)
I20260808 07:02:40.367745 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 10297
I20260808 07:02:40.367838 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:40.368045 26718 external_mini_cluster.cc:1428] Setting key f912f9ded4f1bc24402a77df1807e1cf
I20260808 07:02:40.368842 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 07:02:40.370494 9820 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:02:40.370087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47006 (local address 127.26.23.190:40197)
0808 07:02:40.370171 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:40.370173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:40.370230 (+ 57us) server_negotiation.cc:407] Connection header received
0808 07:02:40.370280 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:40.370281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:40.370285 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:40.370327 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:40.370435 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47006: BlockingRecv error: recv got EOF from 127.0.0.1:47006 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:02:40.370597 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 9854
I20260808 07:02:40.377871 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 10070
I20260808 07:02:40.401551 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 10297
I20260808 07:02:40.411823 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 9719
2026-08-08T07:02:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (562 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:40 dist-test-slave-zj8q krb5kdc[10512](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:40 dist-test-slave-zj8q krb5kdc[10512](info): set up 2 sockets
Aug 08 07:02:40 dist-test-slave-zj8q krb5kdc[10512](info): commencing operation
krb5kdc: starting...
W20260808 07:02:41.554651 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:41 dist-test-slave-zj8q krb5kdc[10512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:02:41.668478 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43397
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:43397
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:41.748443 10533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:41.748638 10533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:41.748680 10533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:41.749780 10533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:02:41.749818 10533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:41.749836 10533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:41.749851 10533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:02:41.749867 10533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:02:41.751353 10533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:43397
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:41.751579 10533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:41.751784 10533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:02:41.756531 10533 server_base.cc:1034] running on GCE node
W20260808 07:02:41.756491 10541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:41.756511 10542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:41.756482 10544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:41.756971 10533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:41.757277 10533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:41.758428 10533 hybrid_clock.cc:648] HybridClock initialized: now 1786172561758411 us; error 35 us; skew 500 ppm
Aug 08 07:02:41 dist-test-slave-zj8q krb5kdc[10512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172561, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:41.760916 10533 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:02:41.761341 10533 webserver.cc:460] Webserver started at http://127.26.23.190:40341/ using document root <none> and password file <none>
I20260808 07:02:41.761538 10533 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:41.761579 10533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:41.761667 10533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:41.762672 10533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "931dad41d51c4862ad438bae9f192e29"
format_stamp: "Formatted at 2026-08-08 07:02:41 on dist-test-slave-zj8q"
server_key: "00dfd8f5b635754c486221b404812865"
server_key_iv: "cf773f4a8d4555627d26e7375c3f5fd3"
server_key_version: "encryptionkey@0"
I20260808 07:02:41.762960 10533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "931dad41d51c4862ad438bae9f192e29"
format_stamp: "Formatted at 2026-08-08 07:02:41 on dist-test-slave-zj8q"
server_key: "00dfd8f5b635754c486221b404812865"
server_key_iv: "cf773f4a8d4555627d26e7375c3f5fd3"
server_key_version: "encryptionkey@0"
I20260808 07:02:41.764132 10533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:41.764737 10556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:41.764899 10533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:41.764984 10533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "931dad41d51c4862ad438bae9f192e29"
format_stamp: "Formatted at 2026-08-08 07:02:41 on dist-test-slave-zj8q"
server_key: "00dfd8f5b635754c486221b404812865"
server_key_iv: "cf773f4a8d4555627d26e7375c3f5fd3"
server_key_version: "encryptionkey@0"
I20260808 07:02:41.765041 10533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:41.777669 10533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:41.779503 10533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:41.779608 10533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:41.783321 10533 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:43397
I20260808 07:02:41.783434 10644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:43397 every 8 connection(s)
I20260808 07:02:41.783680 10533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:02:41.784704 10646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:41.787038 10646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: Bootstrap starting.
I20260808 07:02:41.787606 10646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:41.787859 10646 log.cc:824] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:41.788499 10646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: No bootstrap required, opened a new log
I20260808 07:02:41.790132 10646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931dad41d51c4862ad438bae9f192e29" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43397 } }
I20260808 07:02:41.790310 10646 raft_consensus.cc:374] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:41.790357 10646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931dad41d51c4862ad438bae9f192e29, State: Initialized, Role: FOLLOWER
I20260808 07:02:41.790495 10646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931dad41d51c4862ad438bae9f192e29" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43397 } }
I20260808 07:02:41.790583 10646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:02:41.790616 10646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:02:41.790661 10646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:41.791419 10646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931dad41d51c4862ad438bae9f192e29" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43397 } }
I20260808 07:02:41.791527 10646 leader_election.cc:302] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 931dad41d51c4862ad438bae9f192e29; no voters:
I20260808 07:02:41.791687 10646 leader_election.cc:288] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:02:41.791729 10652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:41.791874 10652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [term 1 LEADER]: Becoming Leader. State: Replica: 931dad41d51c4862ad438bae9f192e29, State: Running, Role: LEADER
I20260808 07:02:41.791944 10646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:02:41.791986 10652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931dad41d51c4862ad438bae9f192e29" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43397 } }
I20260808 07:02:41.792340 10653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "931dad41d51c4862ad438bae9f192e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931dad41d51c4862ad438bae9f192e29" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43397 } } }
I20260808 07:02:41.792434 10653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:41.792346 10655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931dad41d51c4862ad438bae9f192e29. Latest consensus state: current_term: 1 leader_uuid: "931dad41d51c4862ad438bae9f192e29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931dad41d51c4862ad438bae9f192e29" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43397 } } }
I20260808 07:02:41.792524 10655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29 [sys.catalog]: This master's current role is: LEADER
I20260808 07:02:41.792786 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 10533
I20260808 07:02:41.792896 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:02:41.793078 26718 external_mini_cluster.cc:1428] Setting key 2af5f2df9c1f5f6662480b9e2eab024f
W20260808 07:02:41.793910 10678 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:02:41.793967 10678 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:02:41.794013 10662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:02:41.794224 10662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:02:41.795691 10662 catalog_manager.cc:1347] Generated new cluster ID: 836043eb10b7416ca802f9d7af7a4c45
I20260808 07:02:41.795738 10662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:02:41 dist-test-slave-zj8q krb5kdc[10512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:41.805058 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:41.793698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.26.23.190:43397)
0808 07:02:41.793887 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:41.793895 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:41.793922 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:02:41.794035 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:41.794042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:41.794101 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:41.794251 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:41.795146 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:41.796466 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:41.797551 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:41.798198 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:41.798298 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:41.801039 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:41.801043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:41.801043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:41.801054 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:41.803040 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:41.803445 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:41.803448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:41.803449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:41.803570 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:41.803800 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:41.803801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:41.803801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:41.804110 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:41.804605 (+ 495us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:41.804692 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 07:02:41.804831 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260808 07:02:41.813133 10662 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:02:41.813793 10662 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:02:41.821808 10662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: Generated new TSK 0
I20260808 07:02:41.821959 10662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:02:41.850219 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43397
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:41.930560 10690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:41.930745 10690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:41.930768 10690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:41.931869 10690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:41.931912 10690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:41.931941 10690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:02:41.933367 10690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:41.933588 10690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:41.933804 10690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:41.938668 10703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:41.938663 10701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:41.938661 10700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:41.938704 10690 server_base.cc:1034] running on GCE node
I20260808 07:02:41.939034 10690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:41.939242 10690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:41.940375 10690 hybrid_clock.cc:648] HybridClock initialized: now 1786172561940360 us; error 32 us; skew 500 ppm
Aug 08 07:02:41 dist-test-slave-zj8q krb5kdc[10512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172561, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:41.942742 10690 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:02:41.943145 10690 webserver.cc:460] Webserver started at http://127.26.23.129:36265/ using document root <none> and password file <none>
I20260808 07:02:41.943358 10690 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:41.943406 10690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:41.943529 10690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:41.944520 10690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "db99c5b627184fafad94652a07a112b2"
format_stamp: "Formatted at 2026-08-08 07:02:41 on dist-test-slave-zj8q"
server_key: "97f9d52bebb458acd2f85e72139a4982"
server_key_iv: "1a575cbe3596124e0bdab310ca0ee853"
server_key_version: "encryptionkey@0"
I20260808 07:02:41.944854 10690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "db99c5b627184fafad94652a07a112b2"
format_stamp: "Formatted at 2026-08-08 07:02:41 on dist-test-slave-zj8q"
server_key: "97f9d52bebb458acd2f85e72139a4982"
server_key_iv: "1a575cbe3596124e0bdab310ca0ee853"
server_key_version: "encryptionkey@0"
I20260808 07:02:41.946069 10690 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:02:41.946779 10710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:41.946924 10690 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:41.947007 10690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "db99c5b627184fafad94652a07a112b2"
format_stamp: "Formatted at 2026-08-08 07:02:41 on dist-test-slave-zj8q"
server_key: "97f9d52bebb458acd2f85e72139a4982"
server_key_iv: "1a575cbe3596124e0bdab310ca0ee853"
server_key_version: "encryptionkey@0"
I20260808 07:02:41.947068 10690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:41.954360 10690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:41.955942 10690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:41.956063 10690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:41.956252 10690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:41.956509 10690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:41.956542 10690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:41.956568 10690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:41.956593 10690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:41.961923 10690 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:34811
I20260808 07:02:41.961963 10882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:34811 every 8 connection(s)
I20260808 07:02:41.962281 10690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:02:41.965131 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 10690
I20260808 07:02:41.965216 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:02:41.965399 26718 external_mini_cluster.cc:1428] Setting key bdd3ff01c19e7286f8d2745839b063a8
Aug 08 07:02:41 dist-test-slave-zj8q krb5kdc[10512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172561, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:41.971796 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:41.962945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:46415 (local address 127.26.23.190:43397)
0808 07:02:41.962990 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:41.962992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:41.963182 (+ 190us) server_negotiation.cc:407] Connection header received
0808 07:02:41.963664 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:41.963665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:41.963682 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:41.963732 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:41.964630 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:41.965140 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:41.966457 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:41.966670 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:41.966726 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:41.968932 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:41.968934 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:41.968934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:41.968942 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:41.970463 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:41.970822 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:41.970824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:41.970824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:41.970887 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:41.971094 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:41.971095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:41.971096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:41.971258 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:41.971335 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:41.971611 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 07:02:41.971702 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:02:41.971920 10885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:41.962904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43397 (local address 127.26.23.129:46415)
0808 07:02:41.963073 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:41.963105 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:41.963570 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:41.963800 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:41.963805 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:41.964345 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:41.964523 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:41.964528 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:41.965224 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:41.965226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:41.966371 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:41.966374 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:41.966742 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:41.966743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:41.966872 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:41.967314 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:41.967322 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:41.968849 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:41.970541 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:41.970549 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:41.970550 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:41.970754 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:41.970947 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:41.970948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:41.970948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:41.971041 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:41.971352 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:41.971359 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:41.971477 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 07:02:41.971573 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 07:02:41.971697 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260808 07:02:41.972371 10883 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43397
I20260808 07:02:41.972460 10883 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:41.972668 10883 heartbeater.cc:511] Master 127.26.23.190:43397 requested a full tablet report, sending...
I20260808 07:02:41.973222 10595 ts_manager.cc:194] Registered new tserver with Master: db99c5b627184fafad94652a07a112b2 (127.26.23.129:34811)
I20260808 07:02:41.973874 10595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:46415
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:02:41.990866 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43397
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:42.074013 10888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:42.074239 10888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:42.074275 10888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:42.075382 10888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:42.075425 10888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:42.075460 10888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:02:42.076941 10888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:42.077189 10888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:42.077392 10888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:42.082358 10900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:42.082384 10896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:42.082356 10897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:42.082621 10888 server_base.cc:1034] running on GCE node
I20260808 07:02:42.082810 10888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:42.083009 10888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:42.084174 10888 hybrid_clock.cc:648] HybridClock initialized: now 1786172562084160 us; error 31 us; skew 500 ppm
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[10512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172562, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:42.086896 10888 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:02:42.087347 10888 webserver.cc:460] Webserver started at http://127.26.23.130:45745/ using document root <none> and password file <none>
I20260808 07:02:42.087565 10888 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:42.087616 10888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:42.087746 10888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:42.088845 10888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4"
format_stamp: "Formatted at 2026-08-08 07:02:42 on dist-test-slave-zj8q"
server_key: "b252094be897011953afd4570f4f56e1"
server_key_iv: "43c9d1cf25c269606aca54593bd2f5ba"
server_key_version: "encryptionkey@0"
I20260808 07:02:42.089190 10888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4"
format_stamp: "Formatted at 2026-08-08 07:02:42 on dist-test-slave-zj8q"
server_key: "b252094be897011953afd4570f4f56e1"
server_key_iv: "43c9d1cf25c269606aca54593bd2f5ba"
server_key_version: "encryptionkey@0"
I20260808 07:02:42.090461 10888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:02:42.091195 10910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:42.091347 10888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:02:42.091447 10888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4"
format_stamp: "Formatted at 2026-08-08 07:02:42 on dist-test-slave-zj8q"
server_key: "b252094be897011953afd4570f4f56e1"
server_key_iv: "43c9d1cf25c269606aca54593bd2f5ba"
server_key_version: "encryptionkey@0"
I20260808 07:02:42.091511 10888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:42.102185 10888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:42.104290 10888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:42.104424 10888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:42.104627 10888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:42.104918 10888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:42.104950 10888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:42.104979 10888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:42.105005 10888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:42.110852 10888 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:40977
I20260808 07:02:42.110914 11086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:40977 every 8 connection(s)
I20260808 07:02:42.111214 10888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:02:42.115890 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 10888
I20260808 07:02:42.115998 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:02:42.116197 26718 external_mini_cluster.cc:1428] Setting key 98782361c2bd2b337985fe7d25657ccb
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[10512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172562, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:42.120625 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.111911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:52657 (local address 127.26.23.190:43397)
0808 07:02:42.112005 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.112007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.112205 (+ 198us) server_negotiation.cc:407] Connection header received
0808 07:02:42.112691 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.112693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.112705 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.112769 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:42.113776 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.114358 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.115385 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.115589 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.115643 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.117917 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:42.117919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:42.117919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:42.117926 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:42.119239 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:42.119695 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:42.119696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:42.119697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:42.119753 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:42.120004 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:42.120005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:42.120005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:42.120116 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:42.120173 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.120435 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.120521 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 07:02:42.120769 11090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.111855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43397 (local address 127.26.23.130:52657)
0808 07:02:42.112038 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.112084 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.112595 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.112834 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.112838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.113407 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:42.113664 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.113671 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.114458 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.114459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.115299 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.115302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.115669 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.115670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.115821 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.116339 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:42.116349 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:42.117823 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:42.119314 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:42.119322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:42.119324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:42.119612 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:42.119820 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:42.119822 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:42.119822 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:42.119942 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:42.120175 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:42.120182 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:42.120317 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.120404 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.120556 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":103,"threads_started":1}
I20260808 07:02:42.121182 11087 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43397
I20260808 07:02:42.121289 11087 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:42.121477 11087 heartbeater.cc:511] Master 127.26.23.190:43397 requested a full tablet report, sending...
I20260808 07:02:42.121856 10595 ts_manager.cc:194] Registered new tserver with Master: cc9f6d51f8ae43fc89e3e0c5601ba8b4 (127.26.23.130:40977)
I20260808 07:02:42.122287 10595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:52657
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:02:42.140749 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43397
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:02:42.220657 11096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:02:42.220849 11096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:02:42.220886 11096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:02:42.221998 11096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:02:42.222039 11096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:02:42.222064 11096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:02:42.223505 11096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43397
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:02:42.223721 11096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:02:42.223922 11096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:02:42.228755 11108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:02:42.228744 11103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:42.228762 11096 server_base.cc:1034] running on GCE node
W20260808 07:02:42.228747 11104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:02:42.229162 11096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:02:42.229380 11096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:02:42.230522 11096 hybrid_clock.cc:648] HybridClock initialized: now 1786172562230505 us; error 34 us; skew 500 ppm
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[10512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172562, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:02:42.232975 11096 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:02:42.233368 11096 webserver.cc:460] Webserver started at http://127.26.23.131:37047/ using document root <none> and password file <none>
I20260808 07:02:42.233570 11096 fs_manager.cc:359] Metadata directory not provided
I20260808 07:02:42.233613 11096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:02:42.233729 11096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:02:42.234766 11096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b"
format_stamp: "Formatted at 2026-08-08 07:02:42 on dist-test-slave-zj8q"
server_key: "7ae324436d8c4d731cc23f65e7fe1807"
server_key_iv: "3a3075bc6ad66a64dc76db0a92001a32"
server_key_version: "encryptionkey@0"
I20260808 07:02:42.235105 11096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b"
format_stamp: "Formatted at 2026-08-08 07:02:42 on dist-test-slave-zj8q"
server_key: "7ae324436d8c4d731cc23f65e7fe1807"
server_key_iv: "3a3075bc6ad66a64dc76db0a92001a32"
server_key_version: "encryptionkey@0"
I20260808 07:02:42.236346 11096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:02:42.237072 11120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:42.237237 11096 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:02:42.237340 11096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b"
format_stamp: "Formatted at 2026-08-08 07:02:42 on dist-test-slave-zj8q"
server_key: "7ae324436d8c4d731cc23f65e7fe1807"
server_key_iv: "3a3075bc6ad66a64dc76db0a92001a32"
server_key_version: "encryptionkey@0"
I20260808 07:02:42.237409 11096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:02:42.247443 11096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:02:42.249418 11096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:02:42.249573 11096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:02:42.249794 11096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:02:42.250111 11096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:02:42.250180 11096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:42.250218 11096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:02:42.250243 11096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:02:42.255762 11096 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:38067
I20260808 07:02:42.255802 11289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:38067 every 8 connection(s)
I20260808 07:02:42.256091 11096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[10512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172562, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:02:42.264751 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.256723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:48823 (local address 127.26.23.190:43397)
0808 07:02:42.256779 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.256782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.256965 (+ 183us) server_negotiation.cc:407] Connection header received
0808 07:02:42.257470 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.257472 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.257485 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.257536 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:42.258484 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.258980 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.259948 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.260160 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.260214 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.262208 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:42.262210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:42.262210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:42.262218 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:42.263310 (+ 1092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:42.263748 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:42.263749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:42.263750 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:42.263806 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:42.264136 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:42.264137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:42.264138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:42.264253 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:42.264310 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.264577 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.264659 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:02:42.264909 11292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.256677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43397 (local address 127.26.23.131:48823)
0808 07:02:42.256850 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.256885 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.257368 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.257611 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.257615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.258188 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:02:42.258386 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.258391 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.259064 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.259065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.259860 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.259862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.260231 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.260232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.260353 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.260778 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:02:42.260786 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:02:42.262098 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:02:42.263396 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:42.263404 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:42.263406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:42.263673 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:42.263861 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:02:42.263862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:02:42.263863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:02:42.264026 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:02:42.264312 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:02:42.264320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:02:42.264449 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.264552 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.264703 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260808 07:02:42.265395 11290 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43397
I20260808 07:02:42.265501 11290 heartbeater.cc:464] Registering TS with master...
I20260808 07:02:42.265548 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 11096
I20260808 07:02:42.265656 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:02:42.265726 11290 heartbeater.cc:511] Master 127.26.23.190:43397 requested a full tablet report, sending...
I20260808 07:02:42.265872 26718 external_mini_cluster.cc:1428] Setting key 50c90e6947a6675936e8154fcdd4322d
I20260808 07:02:42.266089 10595 ts_manager.cc:194] Registered new tserver with Master: d8ded48f1deb4f4696ec2a1da3fd0f4b (127.26.23.131:38067)
I20260808 07:02:42.266567 10595 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:48823
I20260808 07:02:42.266700 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:02:42.273231 10685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.267894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.26.23.190:43397)
0808 07:02:42.267929 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.267930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.268036 (+ 106us) server_negotiation.cc:407] Connection header received
0808 07:02:42.268089 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.268089 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.268097 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.268144 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:02:42.268720 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.269165 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.269934 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.270119 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.270200 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.271284 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:02:42.271286 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:02:42.271286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:02:42.271292 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:02:42.272347 (+ 1055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:42.272681 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:42.272682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:42.272682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:42.272726 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:02:42.272848 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:02:42.272848 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:02:42.272849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:02:42.272968 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:02:42.273040 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.273116 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.273171 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:02:42.274509 10595 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:02:42.276010 10595 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:02:42.281731 11302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.277906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:40977 (local address 127.0.0.1:39986)
0808 07:02:42.278304 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.278312 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.278352 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.278642 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.278645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.278647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:42.278713 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.278714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.279756 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.279757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.280598 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.280600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.281360 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.281361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.281448 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.281461 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.281596 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.281655 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":6,"thread_start_us":52,"threads_started":1}
I20260808 07:02:42.281767 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.277999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39986 (local address 127.26.23.130:40977)
0808 07:02:42.278245 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.278250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.278351 (+ 101us) server_negotiation.cc:407] Connection header received
0808 07:02:42.278442 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.278445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.278462 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.278620 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:42.278817 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.279675 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.280677 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.281258 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.281356 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.281416 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.281642 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.281684 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":99,"threads_started":1}
I20260808 07:02:42.282445 11298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.278102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:38067 (local address 127.0.0.1:38030)
0808 07:02:42.278437 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.278444 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.278484 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.278708 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.278709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.278711 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:42.278744 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.278746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.279642 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.279643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.281068 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.281072 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.282213 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.282214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.282279 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.282283 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.282333 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.282371 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":29,"thread_start_us":120,"threads_started":1}
I20260808 07:02:42.282470 11305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.278235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38030 (local address 127.26.23.131:38067)
0808 07:02:42.278432 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.278436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.278477 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:02:42.278550 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.278552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.278567 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.278638 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:42.278818 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.279552 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.281174 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.282014 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.282095 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.282177 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.282348 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.282390 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":84,"threads_started":1}
I20260808 07:02:42.282647 10990 tablet_service.cc:1467] Processing CreateTablet for tablet 1186de8962a54899b8f80aed1337fc0d (DEFAULT_TABLE table=test-table [id=003602fab63e46e2a7cbb86173b84904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:42.282995 10990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1186de8962a54899b8f80aed1337fc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:42.283085 11195 tablet_service.cc:1467] Processing CreateTablet for tablet 1186de8962a54899b8f80aed1337fc0d (DEFAULT_TABLE table=test-table [id=003602fab63e46e2a7cbb86173b84904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:42.283391 11195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1186de8962a54899b8f80aed1337fc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:42.285640 11308 tablet_bootstrap.cc:492] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Bootstrap starting.
I20260808 07:02:42.286039 11309 tablet_bootstrap.cc:492] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Bootstrap starting.
I20260808 07:02:42.286367 11308 tablet_bootstrap.cc:654] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:42.286628 11309 tablet_bootstrap.cc:654] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:42.286747 11299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.277906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:34811 (local address 127.0.0.1:43254)
0808 07:02:42.278051 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.278095 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.278187 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.278719 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.278720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.278723 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:42.278788 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.278791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.280975 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.280976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.282002 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.282006 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.286499 (+ 4493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.286500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.286571 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.286577 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.286608 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.286666 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260808 07:02:42.286942 11308 log.cc:824] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:42.287137 11309 log.cc:824] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:42.287153 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.278321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43254 (local address 127.26.23.129:34811)
0808 07:02:42.278539 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.278543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.278554 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:02:42.278593 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.278595 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.278610 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.278714 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:42.279792 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.280880 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.282068 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.286387 (+ 4319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.286921 (+ 534us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.286998 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.287027 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.287073 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
I20260808 07:02:42.287863 10798 tablet_service.cc:1467] Processing CreateTablet for tablet 1186de8962a54899b8f80aed1337fc0d (DEFAULT_TABLE table=test-table [id=003602fab63e46e2a7cbb86173b84904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:02:42.287994 11308 tablet_bootstrap.cc:492] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: No bootstrap required, opened a new log
I20260808 07:02:42.288049 11308 ts_tablet_manager.cc:1397] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:02:42.288208 10798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1186de8962a54899b8f80aed1337fc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:02:42.290021 11308 raft_consensus.cc:348] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.290241 11308 raft_consensus.cc:374] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:42.290289 11308 raft_consensus.cc:729] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9f6d51f8ae43fc89e3e0c5601ba8b4, State: Initialized, Role: FOLLOWER
I20260808 07:02:42.290424 11308 consensus_queue.cc:260] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.290706 11308 ts_tablet_manager.cc:1428] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:02:42.290796 11309 tablet_bootstrap.cc:492] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: No bootstrap required, opened a new log
I20260808 07:02:42.290858 11087 heartbeater.cc:503] Master 127.26.23.190:43397 was elected leader, sending a full tablet report...
I20260808 07:02:42.290887 11309 ts_tablet_manager.cc:1397] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 07:02:42.291378 11314 tablet_bootstrap.cc:492] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: Bootstrap starting.
I20260808 07:02:42.292069 11314 tablet_bootstrap.cc:654] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: Neither blocks nor log segments found. Creating new log.
I20260808 07:02:42.292896 11314 log.cc:824] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:02:42.293155 11309 raft_consensus.cc:348] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.293314 11309 raft_consensus.cc:374] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:42.293388 11309 raft_consensus.cc:729] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8ded48f1deb4f4696ec2a1da3fd0f4b, State: Initialized, Role: FOLLOWER
I20260808 07:02:42.293618 11314 tablet_bootstrap.cc:492] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: No bootstrap required, opened a new log
I20260808 07:02:42.293586 11309 consensus_queue.cc:260] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.293682 11314 ts_tablet_manager.cc:1397] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:02:42.293864 11309 ts_tablet_manager.cc:1428] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:02:42.293896 11290 heartbeater.cc:503] Master 127.26.23.190:43397 was elected leader, sending a full tablet report...
I20260808 07:02:42.295468 11314 raft_consensus.cc:348] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.295616 11314 raft_consensus.cc:374] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:02:42.295644 11314 raft_consensus.cc:729] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db99c5b627184fafad94652a07a112b2, State: Initialized, Role: FOLLOWER
I20260808 07:02:42.295724 11314 consensus_queue.cc:260] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.295934 11314 ts_tablet_manager.cc:1428] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:02:42.296010 10883 heartbeater.cc:503] Master 127.26.23.190:43397 was elected leader, sending a full tablet report...
I20260808 07:02:42.301811 11318 raft_consensus.cc:482] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:02:42.301901 11318 raft_consensus.cc:504] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.302246 11318 leader_election.cc:288] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc9f6d51f8ae43fc89e3e0c5601ba8b4 (127.26.23.130:40977), db99c5b627184fafad94652a07a112b2 (127.26.23.129:34811)
I20260808 07:02:42.304857 11300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.302428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:57109 (local address 127.26.23.130:40977)
0808 07:02:42.302476 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.302478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.302488 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:02:42.302560 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.302561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.302570 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.302616 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:42.302760 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.303235 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.304131 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.304512 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.304584 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.304594 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.304742 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.304791 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:02:42.304845 11292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.302373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:40977 (local address 127.26.23.131:57109)
0808 07:02:42.302429 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.302441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.302485 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.302617 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.302618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.302620 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:42.302684 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.302686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.303306 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.303307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.304049 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.304051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.304600 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.304601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.304679 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.304682 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.304733 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.304772 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":18}
I20260808 07:02:42.304917 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.302477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38827 (local address 127.26.23.129:34811)
0808 07:02:42.302513 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.302514 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.302621 (+ 107us) server_negotiation.cc:407] Connection header received
0808 07:02:42.302650 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.302651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.302660 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.302705 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:02:42.302852 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.303333 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.304224 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.304612 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.304683 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.304691 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.304829 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.304862 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:02:42.305171 11021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1186de8962a54899b8f80aed1337fc0d" candidate_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" is_pre_election: true
I20260808 07:02:42.305312 11021 raft_consensus.cc:2454] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ded48f1deb4f4696ec2a1da3fd0f4b in term 0.
I20260808 07:02:42.305413 11323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.302402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:34811 (local address 127.26.23.131:38827)
0808 07:02:42.302536 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.302545 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:02:42.302606 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:02:42.302722 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:02:42.302722 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:02:42.302724 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:02:42.302791 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.302792 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.303404 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.303405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.304149 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:02:42.304151 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.304688 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.304688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:02:42.304759 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.304762 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:02:42.304807 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:02:42.304838 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260808 07:02:42.305542 11124 leader_election.cc:302] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc9f6d51f8ae43fc89e3e0c5601ba8b4, d8ded48f1deb4f4696ec2a1da3fd0f4b; no voters:
I20260808 07:02:42.305711 10824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1186de8962a54899b8f80aed1337fc0d" candidate_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db99c5b627184fafad94652a07a112b2" is_pre_election: true
I20260808 07:02:42.305800 11318 raft_consensus.cc:2781] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:02:42.305858 10824 raft_consensus.cc:2454] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8ded48f1deb4f4696ec2a1da3fd0f4b in term 0.
I20260808 07:02:42.305871 11318 raft_consensus.cc:482] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:02:42.305895 11318 raft_consensus.cc:3037] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:42.306658 11318 raft_consensus.cc:504] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.306783 11318 leader_election.cc:288] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [CANDIDATE]: Term 1 election: Requested vote from peers cc9f6d51f8ae43fc89e3e0c5601ba8b4 (127.26.23.130:40977), db99c5b627184fafad94652a07a112b2 (127.26.23.129:34811)
I20260808 07:02:42.306917 10824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1186de8962a54899b8f80aed1337fc0d" candidate_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db99c5b627184fafad94652a07a112b2"
I20260808 07:02:42.306995 10824 raft_consensus.cc:3037] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:42.306990 11021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1186de8962a54899b8f80aed1337fc0d" candidate_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4"
I20260808 07:02:42.307087 11021 raft_consensus.cc:3037] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:02:42.307755 10824 raft_consensus.cc:2454] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ded48f1deb4f4696ec2a1da3fd0f4b in term 1.
I20260808 07:02:42.307893 11021 raft_consensus.cc:2454] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8ded48f1deb4f4696ec2a1da3fd0f4b in term 1.
I20260808 07:02:42.307915 11125 leader_election.cc:302] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8ded48f1deb4f4696ec2a1da3fd0f4b, db99c5b627184fafad94652a07a112b2; no voters:
I20260808 07:02:42.307993 11318 raft_consensus.cc:2781] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:02:42.308136 11318 raft_consensus.cc:686] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 1 LEADER]: Becoming Leader. State: Replica: d8ded48f1deb4f4696ec2a1da3fd0f4b, State: Running, Role: LEADER
I20260808 07:02:42.308248 11318 consensus_queue.cc:237] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } }
I20260808 07:02:42.308979 10595 catalog_manager.cc:5495] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b reported cstate change: term changed from 0 to 1, leader changed from <none> to d8ded48f1deb4f4696ec2a1da3fd0f4b (127.26.23.131). New cstate: current_term: 1 leader_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8ded48f1deb4f4696ec2a1da3fd0f4b" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38067 } health_report { overall_health: HEALTHY } } }
I20260808 07:02:42.319218 11305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.317147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38038 (local address 127.26.23.131:38067)
0808 07:02:42.317194 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:02:42.317195 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:02:42.317203 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:02:42.317230 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:02:42.317231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:02:42.317245 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:02:42.317298 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:02:42.317442 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.317893 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.318617 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:02:42.318797 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:02:42.318841 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:02:42.318951 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:02:42.319039 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:02:42.319091 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:02:42.319114 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 07:02:42.319129 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:02:42.320842 10824 raft_consensus.cc:1261] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 1 FOLLOWER]: Refusing update from remote peer d8ded48f1deb4f4696ec2a1da3fd0f4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:42.320842 11021 raft_consensus.cc:1261] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 1 FOLLOWER]: Refusing update from remote peer d8ded48f1deb4f4696ec2a1da3fd0f4b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:02:42.321177 11326 consensus_queue.cc:1035] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "db99c5b627184fafad94652a07a112b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:42.321338 11318 consensus_queue.cc:1035] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9f6d51f8ae43fc89e3e0c5601ba8b4" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:02:42.325587 10594 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:42.325683 10594 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:02:42.326448 10594 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 931dad41d51c4862ad438bae9f192e29: Sending DeleteTablet for 3 replicas of tablet 1186de8962a54899b8f80aed1337fc0d
I20260808 07:02:42.326799 10990 tablet_service.cc:1514] Processing DeleteTablet for tablet 1186de8962a54899b8f80aed1337fc0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:42 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:39986
I20260808 07:02:42.326802 11195 tablet_service.cc:1514] Processing DeleteTablet for tablet 1186de8962a54899b8f80aed1337fc0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:42 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38030
I20260808 07:02:42.327001 11345 tablet_replica.cc:330] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: stopping tablet replica
I20260808 07:02:42.327018 10798 tablet_service.cc:1514] Processing DeleteTablet for tablet 1186de8962a54899b8f80aed1337fc0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:02:42 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:43254
I20260808 07:02:42.327113 11345 raft_consensus.cc:2229] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:02:42.327198 11345 raft_consensus.cc:2258] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:42.327214 11346 tablet_replica.cc:330] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: stopping tablet replica
I20260808 07:02:42.327322 11346 raft_consensus.cc:2229] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:42.327411 11346 raft_consensus.cc:2258] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:42.327544 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 10690
I20260808 07:02:42.327554 11347 tablet_replica.cc:330] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2: stopping tablet replica
I20260808 07:02:42.327603 11345 ts_tablet_manager.cc:1905] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:42.327636 11347 raft_consensus.cc:2229] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:02:42.327718 11347 raft_consensus.cc:2258] T 1186de8962a54899b8f80aed1337fc0d P db99c5b627184fafad94652a07a112b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:02:42.328531 11346 ts_tablet_manager.cc:1905] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:02:42.330080 11346 ts_tablet_manager.cc:1918] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:42.330147 11346 log.cc:1196] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/1186de8962a54899b8f80aed1337fc0d
I20260808 07:02:42.330471 11346 ts_tablet_manager.cc:1939] T 1186de8962a54899b8f80aed1337fc0d P cc9f6d51f8ae43fc89e3e0c5601ba8b4: Deleting consensus metadata
I20260808 07:02:42.330854 10561 catalog_manager.cc:4841] TS cc9f6d51f8ae43fc89e3e0c5601ba8b4 (127.26.23.130:40977): tablet 1186de8962a54899b8f80aed1337fc0d (table test-table [id=003602fab63e46e2a7cbb86173b84904]) successfully deleted
I20260808 07:02:42.333236 11345 ts_tablet_manager.cc:1918] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:02:42.333318 11345 log.cc:1196] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/1186de8962a54899b8f80aed1337fc0d
I20260808 07:02:42.333642 11345 ts_tablet_manager.cc:1939] T 1186de8962a54899b8f80aed1337fc0d P d8ded48f1deb4f4696ec2a1da3fd0f4b: Deleting consensus metadata
I20260808 07:02:42.361707 10561 catalog_manager.cc:4841] TS d8ded48f1deb4f4696ec2a1da3fd0f4b (127.26.23.131:38067): tablet 1186de8962a54899b8f80aed1337fc0d (table test-table [id=003602fab63e46e2a7cbb86173b84904]) successfully deleted
W20260808 07:02:42.367136 10565 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:34811 (error 108)
I20260808 07:02:42.367326 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 10888
I20260808 07:02:42.375201 11299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:02:42.375049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:34811 (local address 127.0.0.1:43266)
0808 07:02:42.375113 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 07:02:42.375161 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:34811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 07:02:42.375324 10565 catalog_manager.cc:4584] TS db99c5b627184fafad94652a07a112b2 (127.26.23.129:34811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1186de8962a54899b8f80aed1337fc0d: Network error: Client connection negotiation failed: client connection to 127.26.23.129:34811: connect: Connection refused (error 111)
I20260808 07:02:42.392665 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 11096
I20260808 07:02:42.404556 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 10533
2026-08-08T07:02:42Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1991 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[11351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[11351](info): set up 2 sockets
Aug 08 07:02:42 dist-test-slave-zj8q krb5kdc[11351](info): commencing operation
krb5kdc: starting...
W20260808 07:02:43.543720 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:02:43 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:02:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:02:43Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/rangeradmin_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/rangeradmin_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/rangerlookup_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/rangerlookup_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
I20260808 07:02:43.700618 26718 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGJ9A1U/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/postgres -l logfile start
2026-08-08 07:02:45.924 UTC [11391] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 07:02:45.924 UTC [11391] LOG: listening on IPv4 address "127.26.23.148", port 51211
2026-08-08 07:02:45.926 UTC [11391] LOG: listening on Unix socket "/tmp/.s.PGSQL.51211"
2026-08-08 07:02:45.946 UTC [11396] LOG: database system was shut down at 2026-08-08 07:02:44 UTC
2026-08-08 07:02:45.949 UTC [11391] LOG: database system is ready to accept connections
I20260808 07:02:47.009693 26718 mini_postgres.cc:96] Postgres bound to 51211
2026-08-08 07:02:47.016 UTC [11407] FATAL: database "slave" does not exist
127.26.23.148:51211 - accepting connections
I20260808 07:02:47.017153 26718 mini_ranger.cc:161] Starting Ranger...
I20260808 07:02:47.031683 26718 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 07:02:47.435544 26718 mini_ranger.cc:87] Created ranger Postgres database
I20260808 07:02:47.435649 26718 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-admin
2026-08-08 07:02:47,710 [I] DB FLAVOR :POSTGRES
2026-08-08 07:02:47,711 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:02:47,711 [I] Checking connection..
2026-08-08 07:02:47,711 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 07:02:47,967 [I] Checking connection passed.
2026-08-08 07:02:47,967 [I] --------- Verifying version history table ---------
2026-08-08 07:02:47,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:02:48,201 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:02:48,201 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:02:48,449 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:02:48,449 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 07:02:48,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 07:02:48.675 UTC [11504] WARNING: there is no transaction in progress
2026-08-08 07:02:48,683 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 07:02:48,683 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:02:48,920 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 07:02:48,921 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:02:48,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 07:02:49,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 07:02:49,397 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zj8q.c.gcp-upstream.internal','N') ;"
2026-08-08 07:02:49,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:02:49,867 [I] Table x_portal_user does not exist in database ranger
2026-08-08 07:02:49,867 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:02:50,104 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 07:02:50,105 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:02:50,361 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:02:50,601 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 07:02:50,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 07:02:51.483 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.498 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.513 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.527 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.541 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.557 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.607 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.613 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.626 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.635 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.644 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.656 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.665 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.671 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.677 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:51.682 UTC [11679] WARNING: there is no transaction in progress
2026-08-08 07:02:52,248 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 07:02:52,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 07:02:52,500 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 07:02:52,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:02:52,731 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 07:02:52,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:02:52,990 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 07:02:52,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:02:53,240 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:02:53,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zj8q.c.gcp-upstream.internal';"
2026-08-08 07:02:53,728 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 07:02:53,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 07:02:53,971 [I] DB_PATCHES have already been applied
I20260808 07:02:53.976735 26718 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGJ9A1U/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 07:02:53.976804 26718 mini_ranger.cc:193] Using host: 127.26.23.148
I20260808 07:02:53.980388 26718 mini_ranger.cc:227] Ranger admin URL: http://127.26.23.148:56161
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 7:02:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 07:02:55.245007 26718 mini_ranger.cc:160] Time spent starting Ranger: real 8.228s user 0.000s sys 0.009s
Aug 08, 2026 7:03:13 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 7:03:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 7:03:13 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 7:03:13 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 7:03:14 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 07:03:15.216291 26718 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/rangerkms_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/rangerkms_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.23.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.23.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 07:03:15 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172595, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 07:03:15.300390 26718 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 07:03:15.309883 26718 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 07:03:16.067514 26718 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 07:03:16.067588 26718 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms
I20260808 07:03:16.067600 26718 mini_ranger_kms.cc:227] Using postgres at 127.26.23.148:51211
2026-08-08 07:03:16,234 [I] DB FLAVOR :POSTGRES
2026-08-08 07:03:16,235 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:03:16,235 [I] Checking connection
2026-08-08 07:03:16,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 07:03:16,485 [I] connection success
2026-08-08 07:03:16,485 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 07:03:16,485 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 07:03:16,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 07:03:16,713 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 07:03:16,713 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:03:16,713 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 07:03:16,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:51211/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 07:03:16,964 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 07:03:17.390265 26718 mini_ranger_kms.cc:310] Created kms service
I20260808 07:03:17.585687 26718 mini_ranger_kms.cc:326] Created kudu user
I20260808 07:03:17.626843 26718 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 07:03:17 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172595, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:03:18.010385 26718 mini_ranger_kms.cc:384] Added ranger policy
I20260808 07:03:18.010495 26718 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 07:03:18.010515 26718 mini_ranger_kms.cc:240] Using host: 127.26.23.148
I20260808 07:03:18.015764 26718 mini_ranger_kms.cc:276] Ranger KMS PID: 11958
I20260808 07:03:18.015925 26718 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.23.148:46367
Aug 08, 2026 7:03:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:03:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:03:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 7:03:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 7:03:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 7:03:19 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 07:03:20 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172600, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.23.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:03:20.506631 26718 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.206s user 0.015s sys 0.136s
I20260808 07:03:20.506750 26718 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 07:03:20.506825 26718 mini_ranger_kms.cc:401] 127.26.23.148:46367/kms/v1/keys
Aug 08 07:03:20 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172600, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.23.148@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
Aug 08 07:03:21 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172600, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.23.148@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
Aug 08 07:03:23 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:03:23.250296 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39383
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39383
--ranger_config_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:46367/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:03:23.331498 12038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:03:23.331710 12038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:03:23.331732 12038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:03:23.332844 12038 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:03:23.332885 12038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:03:23.332897 12038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:03:23.332908 12038 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:03:23.332918 12038 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:03:23.334470 12038 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.23.148:46367/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39383
--ranger_config_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:03:23.334699 12038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:03:23.334920 12038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:03:23.340799 12052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:23.340844 12049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:23.340806 12048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:03:23.341032 12038 server_base.cc:1034] running on GCE node
I20260808 07:03:23.341343 12038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:03:23.341665 12038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:03:23.342830 12038 hybrid_clock.cc:648] HybridClock initialized: now 1786172603342830 us; error 56 us; skew 500 ppm
Aug 08 07:03:23 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:03:23.348424 12038 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:03:23.348954 12038 webserver.cc:460] Webserver started at http://127.26.23.190:44253/ using document root <none> and password file <none>
I20260808 07:03:23.349197 12038 fs_manager.cc:359] Metadata directory not provided
I20260808 07:03:23.349248 12038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:03:23.349378 12038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:03:23 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172603, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:03:23.402742 12038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "1e804f9966f04606bc07a218f58c0856"
format_stamp: "Formatted at 2026-08-08 07:03:23 on dist-test-slave-zj8q"
server_key: "2ce018b3e73b4b9e06d82009a66ded29"
server_key_iv: "4ee3130cfd0e1d2578521b6677821f8c"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:23.403227 12038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "1e804f9966f04606bc07a218f58c0856"
format_stamp: "Formatted at 2026-08-08 07:03:23 on dist-test-slave-zj8q"
server_key: "2ce018b3e73b4b9e06d82009a66ded29"
server_key_iv: "4ee3130cfd0e1d2578521b6677821f8c"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:23.405350 12038 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:03:23.420924 12063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:23.421098 12038 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:03:23.421196 12038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "1e804f9966f04606bc07a218f58c0856"
format_stamp: "Formatted at 2026-08-08 07:03:23 on dist-test-slave-zj8q"
server_key: "2ce018b3e73b4b9e06d82009a66ded29"
server_key_iv: "4ee3130cfd0e1d2578521b6677821f8c"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:23.421298 12038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:03:23.451066 12038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:03:23.452967 12038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:03:23.453116 12038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:03:23.457353 12038 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39383
I20260808 07:03:23.457396 12147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39383 every 8 connection(s)
I20260808 07:03:23.457719 12038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:03:23.458431 12148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:03:23.460645 12148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856: Bootstrap starting.
I20260808 07:03:23.461176 12148 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856: Neither blocks nor log segments found. Creating new log.
I20260808 07:03:23.461413 12148 log.cc:824] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856: Log is configured to *not* fsync() on all Append() calls
I20260808 07:03:23.462023 12148 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856: No bootstrap required, opened a new log
I20260808 07:03:23.464054 12148 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e804f9966f04606bc07a218f58c0856" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39383 } }
I20260808 07:03:23.464211 12148 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:03:23.464233 12148 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e804f9966f04606bc07a218f58c0856, State: Initialized, Role: FOLLOWER
I20260808 07:03:23.464339 12148 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e804f9966f04606bc07a218f58c0856" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39383 } }
I20260808 07:03:23.464414 12148 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:03:23.464442 12148 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:03:23.464473 12148 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:03:23.464954 12148 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e804f9966f04606bc07a218f58c0856" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39383 } }
I20260808 07:03:23.465039 12148 leader_election.cc:302] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e804f9966f04606bc07a218f58c0856; no voters:
I20260808 07:03:23.465179 12148 leader_election.cc:288] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:03:23.465231 12154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:03:23.465399 12148 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:03:23.465436 12154 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [term 1 LEADER]: Becoming Leader. State: Replica: 1e804f9966f04606bc07a218f58c0856, State: Running, Role: LEADER
I20260808 07:03:23.465587 12154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e804f9966f04606bc07a218f58c0856" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39383 } }
I20260808 07:03:23.465939 12159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e804f9966f04606bc07a218f58c0856. Latest consensus state: current_term: 1 leader_uuid: "1e804f9966f04606bc07a218f58c0856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e804f9966f04606bc07a218f58c0856" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39383 } } }
I20260808 07:03:23.466022 12159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [sys.catalog]: This master's current role is: LEADER
I20260808 07:03:23.466091 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 12038
I20260808 07:03:23.466207 12157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e804f9966f04606bc07a218f58c0856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e804f9966f04606bc07a218f58c0856" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39383 } } }
I20260808 07:03:23.466271 12170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:03:23.466349 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:03:23.466568 26718 external_mini_cluster.cc:1428] Setting key 06ca3299cd1161b42cf20a238c47c703
I20260808 07:03:23.466282 12157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856 [sys.catalog]: This master's current role is: LEADER
I20260808 07:03:23.467186 12170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:03:23.467612 12148 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:03:23.468758 12170 catalog_manager.cc:1347] Generated new cluster ID: 3dd01d39ecd8410bb70a94a791cfce93
I20260808 07:03:23.468808 12170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:03:23 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:03:23.481580 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:23.467042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.26.23.190:39383)
0808 07:03:23.467548 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:23.467558 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:23.467825 (+ 267us) server_negotiation.cc:407] Connection header received
0808 07:03:23.468050 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:23.468058 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:23.468116 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:23.468233 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:03:23.469108 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:23.472870 (+ 3762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:23.473920 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:23.474449 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:23.474552 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:23.477370 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:03:23.477375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:03:23.477375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:03:23.477388 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:03:23.479421 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:23.479862 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:23.479865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:23.479866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:23.479983 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:23.480232 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:23.480233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:23.480233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:23.480586 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:03:23.481117 (+ 531us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:23.481207 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:03:23.481341 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":87,"threads_started":1}
I20260808 07:03:23.490229 12170 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:03:23.490935 12170 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:03:23.502234 12170 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856: Generated new TSK 0
I20260808 07:03:23.502465 12170 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:03:24.176780 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:46367/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39383
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:03:24.283656 12223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:03:24.283859 12223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:03:24.283881 12223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:03:24.285049 12223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:03:24.285091 12223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:03:24.285116 12223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:03:24.286676 12223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.23.148:46367/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:03:24.286911 12223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:03:24.287137 12223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:03:24.292042 12232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:24.292153 12235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:24.292047 12233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:03:24.292452 12223 server_base.cc:1034] running on GCE node
I20260808 07:03:24.292639 12223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:03:24.292850 12223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:03:24.294008 12223 hybrid_clock.cc:648] HybridClock initialized: now 1786172604293984 us; error 35 us; skew 500 ppm
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:03:24.297284 12223 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:03:24.297781 12223 webserver.cc:460] Webserver started at http://127.26.23.129:40777/ using document root <none> and password file <none>
I20260808 07:03:24.298048 12223 fs_manager.cc:359] Metadata directory not provided
I20260808 07:03:24.298127 12223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:03:24.298303 12223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:03:24.311920 12223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "186d40239fb44a98a9fe591ee1350e49"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "a640081f0153806909ef3154f2b00cda"
server_key_iv: "b5bc9a2df55d06669a67d9e07c654078"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.312404 12223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "186d40239fb44a98a9fe591ee1350e49"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "a640081f0153806909ef3154f2b00cda"
server_key_iv: "b5bc9a2df55d06669a67d9e07c654078"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.314174 12223 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:03:24.362342 12252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.362637 12223 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.000s
I20260808 07:03:24.362771 12223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "186d40239fb44a98a9fe591ee1350e49"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "a640081f0153806909ef3154f2b00cda"
server_key_iv: "b5bc9a2df55d06669a67d9e07c654078"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.362866 12223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:03:24.382642 12223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:03:24.385161 12223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:03:24.385404 12223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:03:24.385715 12223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:03:24.386179 12223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:03:24.386278 12223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.386381 12223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:03:24.386454 12223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.393847 12223 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:46123
I20260808 07:03:24.394364 12223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:03:24.395792 12435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:46123 every 8 connection(s)
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:03:24.404377 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 12223
I20260808 07:03:24.404482 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:03:24.404688 26718 external_mini_cluster.cc:1428] Setting key 8c6a22352b79aa4323c51b7ed89a26f0
I20260808 07:03:24.405727 12438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.395207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39383 (local address 127.26.23.129:43649)
0808 07:03:24.395393 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.395443 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.396087 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.396386 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.396390 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.396634 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:03:24.396922 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.396929 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.397919 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.397920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.399245 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.399249 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.399769 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.399770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.399928 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.400479 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:03:24.400489 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:03:24.402124 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:03:24.404111 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:03:24.404118 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:03:24.404121 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:03:24.404385 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:03:24.404669 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:03:24.404669 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:03:24.404670 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:03:24.404798 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:03:24.405076 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:03:24.405083 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:03:24.405240 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.405331 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.405474 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260808 07:03:24.406056 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.395457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:43649 (local address 127.26.23.190:39383)
0808 07:03:24.395681 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.395684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.395697 (+ 13us) server_negotiation.cc:407] Connection header received
0808 07:03:24.396212 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.396214 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.396229 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.396317 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:03:24.397026 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.397816 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.399341 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.399676 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.399746 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.402252 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:03:24.402255 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:03:24.402255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:03:24.402264 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:03:24.404027 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.404469 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.404471 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.404471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.404601 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.404860 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.404861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.404861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.404996 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:03:24.405052 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.405870 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.405968 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":86,"threads_started":1}
I20260808 07:03:24.408027 12436 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39383
I20260808 07:03:24.408164 12436 heartbeater.cc:464] Registering TS with master...
I20260808 07:03:24.408396 12436 heartbeater.cc:511] Master 127.26.23.190:39383 requested a full tablet report, sending...
I20260808 07:03:24.408977 12089 ts_manager.cc:194] Registered new tserver with Master: 186d40239fb44a98a9fe591ee1350e49 (127.26.23.129:46123)
I20260808 07:03:24.409880 12089 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:43649
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:03:24.441380 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:46367/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39383
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 07:03:24.533283 12448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:03:24.533674 12448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:03:24.533778 12448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:03:24.535559 12448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:03:24.535693 12448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:03:24.535784 12448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:03:24.538259 12448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.23.148:46367/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:03:24.538784 12448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:03:24.539111 12448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:03:24.545557 12456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:24.546072 12455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:24.546272 12459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:03:24.547467 12448 server_base.cc:1034] running on GCE node
I20260808 07:03:24.547693 12448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:03:24.547957 12448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:03:24.549129 12448 hybrid_clock.cc:648] HybridClock initialized: now 1786172604549105 us; error 36 us; skew 500 ppm
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:03:24.551769 12448 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:03:24.552174 12448 webserver.cc:460] Webserver started at http://127.26.23.130:36563/ using document root <none> and password file <none>
I20260808 07:03:24.552443 12448 fs_manager.cc:359] Metadata directory not provided
I20260808 07:03:24.552505 12448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:03:24.552634 12448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:03:24.568815 12448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "64e141373f00465c98634556771c4ddd"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "eb0bac7c797339ffd3c8c4eb83688d6c"
server_key_iv: "ccb7827a208f67f84536557a0d9fc62c"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.569435 12448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "64e141373f00465c98634556771c4ddd"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "eb0bac7c797339ffd3c8c4eb83688d6c"
server_key_iv: "ccb7827a208f67f84536557a0d9fc62c"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.574565 12448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s
I20260808 07:03:24.589696 12467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.590193 12448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:03:24.590320 12448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "64e141373f00465c98634556771c4ddd"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "eb0bac7c797339ffd3c8c4eb83688d6c"
server_key_iv: "ccb7827a208f67f84536557a0d9fc62c"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.590422 12448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:03:24.637586 12448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:03:24.639894 12448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:03:24.640036 12448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:03:24.640275 12448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:03:24.640681 12448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:03:24.640726 12448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.640756 12448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:03:24.640815 12448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.648213 12448 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:33583
I20260808 07:03:24.648620 12448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:03:24.648762 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 12448
I20260808 07:03:24.648877 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:03:24.649089 26718 external_mini_cluster.cc:1428] Setting key c1218656535913d5f9e2eec1a942a746
I20260808 07:03:24.649091 12645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:33583 every 8 connection(s)
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:03:24.665436 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.649551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60073 (local address 127.26.23.190:39383)
0808 07:03:24.649623 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.649625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.649891 (+ 266us) server_negotiation.cc:407] Connection header received
0808 07:03:24.650465 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.650466 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.650483 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.650532 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:03:24.651061 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.651659 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.658414 (+ 6755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.658736 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.658791 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.662186 (+ 3395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:03:24.662188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:03:24.662188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:03:24.662197 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:03:24.663686 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.664124 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.664126 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.664127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.664200 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.664541 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.664543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.664543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.664698 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:03:24.664746 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.665210 (+ 464us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.665337 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:03:24.666128 12649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.649582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39383 (local address 127.26.23.130:60073)
0808 07:03:24.649764 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.649814 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.650371 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.650603 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.650607 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.650787 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:03:24.650974 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.650979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.651785 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.651787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.652995 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.652999 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.658900 (+ 5901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.658901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.659068 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.659579 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:03:24.659589 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:03:24.662056 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:03:24.663765 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:03:24.663773 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:03:24.663776 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:03:24.664014 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:03:24.664290 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:03:24.664292 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:03:24.664292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:03:24.664453 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:03:24.664797 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:03:24.664849 (+ 52us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:03:24.665023 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.665600 (+ 577us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.665782 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260808 07:03:24.666848 12646 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39383
I20260808 07:03:24.666960 12646 heartbeater.cc:464] Registering TS with master...
I20260808 07:03:24.667165 12646 heartbeater.cc:511] Master 127.26.23.190:39383 requested a full tablet report, sending...
I20260808 07:03:24.667582 12089 ts_manager.cc:194] Registered new tserver with Master: 64e141373f00465c98634556771c4ddd (127.26.23.130:33583)
I20260808 07:03:24.668062 12089 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:60073
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:03:24.682035 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:46367/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39383
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:03:24.790652 12652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:03:24.791007 12652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:03:24.791095 12652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:03:24.792778 12652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:03:24.792891 12652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:03:24.792972 12652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:03:24.795030 12652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.23.148:46367/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:03:24.795467 12652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:03:24.795764 12652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:03:24.802035 12665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:24.802568 12661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:03:24.804443 12671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:03:24.805696 12652 server_base.cc:1034] running on GCE node
I20260808 07:03:24.806000 12652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:03:24.806291 12652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:03:24.807459 12652 hybrid_clock.cc:648] HybridClock initialized: now 1786172604807419 us; error 52 us; skew 500 ppm
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:03:24.810719 12652 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:03:24.811300 12652 webserver.cc:460] Webserver started at http://127.26.23.131:32853/ using document root <none> and password file <none>
I20260808 07:03:24.811558 12652 fs_manager.cc:359] Metadata directory not provided
I20260808 07:03:24.811625 12652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:03:24.811816 12652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:03:24.828713 12652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "f0533d5e10cc44608e3f852f773e6798"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "b9ab96772a8406f2b93b57ea12f0f5c2"
server_key_iv: "902ce096734d7933d55b8e74dce2aa70"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.829146 12652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "f0533d5e10cc44608e3f852f773e6798"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "b9ab96772a8406f2b93b57ea12f0f5c2"
server_key_iv: "902ce096734d7933d55b8e74dce2aa70"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.830853 12652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 07:03:24.854491 12680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.854797 12652 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 07:03:24.854918 12652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "f0533d5e10cc44608e3f852f773e6798"
format_stamp: "Formatted at 2026-08-08 07:03:24 on dist-test-slave-zj8q"
server_key: "b9ab96772a8406f2b93b57ea12f0f5c2"
server_key_iv: "902ce096734d7933d55b8e74dce2aa70"
server_key_version: "kuduclusterkey@0"
I20260808 07:03:24.855041 12652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:03:24.878782 12652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:03:24.880803 12652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:03:24.881014 12652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:03:24.881302 12652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:03:24.881691 12652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:03:24.881739 12652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.881770 12652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:03:24.881788 12652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:03:24.889250 12652 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:45229
I20260808 07:03:24.889693 12652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:03:24.890681 12844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:45229 every 8 connection(s)
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:03:24.899567 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 12652
I20260808 07:03:24.899675 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:03:24.899863 26718 external_mini_cluster.cc:1428] Setting key 9381bc5d00ae2cd893117dc038dadfe8
I20260808 07:03:24.901257 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.892239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:52731 (local address 127.26.23.190:39383)
0808 07:03:24.892282 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.892284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.892294 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:03:24.892823 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.892824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.892838 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.892890 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:03:24.893531 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.894102 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.895114 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.895351 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.895406 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.897653 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:03:24.897655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:03:24.897655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:03:24.897663 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:03:24.899277 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.899706 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.899708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.899708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.899770 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.900150 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.900151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.900151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.900296 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:03:24.900357 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.901076 (+ 719us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.901164 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:03:24.901733 12850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.891948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39383 (local address 127.26.23.131:52731)
0808 07:03:24.892114 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.892159 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.892713 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.892963 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.892968 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.893225 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:03:24.893431 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.893437 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.894208 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.894209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.895025 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.895027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.895438 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.895439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.895557 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.896032 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:03:24.896041 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:03:24.897525 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:03:24.899369 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:03:24.899377 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:03:24.899379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:03:24.899615 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:03:24.899828 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:03:24.899829 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:03:24.899829 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:03:24.899939 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:03:24.900349 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:03:24.900356 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:03:24.900906 (+ 550us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.901359 (+ 453us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.901521 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260808 07:03:24.902179 12845 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39383
I20260808 07:03:24.902278 12845 heartbeater.cc:464] Registering TS with master...
I20260808 07:03:24.902472 12845 heartbeater.cc:511] Master 127.26.23.190:39383 requested a full tablet report, sending...
I20260808 07:03:24.902856 12089 ts_manager.cc:194] Registered new tserver with Master: f0533d5e10cc44608e3f852f773e6798 (127.26.23.131:45229)
I20260808 07:03:24.903335 12089 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:52731
I20260808 07:03:24.911530 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:03:24.920804 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.913250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51220 (local address 127.26.23.190:39383)
0808 07:03:24.913292 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.913294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.913426 (+ 132us) server_negotiation.cc:407] Connection header received
0808 07:03:24.913517 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.913518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.913529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.913557 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:03:24.914376 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.915136 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.916207 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.916511 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.916552 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.918019 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:03:24.918021 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:03:24.918021 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:03:24.918028 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:03:24.919598 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.919967 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.919968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.919969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.920024 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:03:24.920211 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:03:24.920211 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:03:24.920212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:03:24.920341 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:03:24.920411 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.920639 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.920712 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:03:24.922959 12089 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:03:24.925225 12089 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:03:24.934641 12876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.929214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45186 (local address 127.26.23.129:46123)
0808 07:03:24.929362 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.929365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.929373 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:03:24.929402 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.929404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.929417 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.929483 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:03:24.929950 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.931119 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.932860 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.934212 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.934282 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.934346 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.934517 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.934562 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":68,"threads_started":1}
I20260808 07:03:24.934976 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.928998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:46123 (local address 127.0.0.1:45186)
0808 07:03:24.929140 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.929147 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.929180 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.929833 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.929833 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.929835 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:03:24.929868 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.929869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.931221 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.931222 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.932764 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.932766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.934284 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.934285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.934369 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.934386 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.934455 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.934902 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":385,"thread_start_us":65,"threads_started":1}
I20260808 07:03:24.935799 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.928481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:33583 (local address 127.0.0.1:45802)
0808 07:03:24.929008 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.929016 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.929055 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.929871 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.929872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.929873 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:03:24.929900 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.929901 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.932457 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.932458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.933458 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.933461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.935592 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.935593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.935653 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.935658 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.935686 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.935723 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":4,"thread_start_us":88,"threads_started":1}
I20260808 07:03:24.935879 12328 tablet_service.cc:1467] Processing CreateTablet for tablet 69252a8022d345ad9d124c478d85247d (DEFAULT_TABLE table=test-table [id=7308a4a85569426c9a2fa1f9f0ef3849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:03:24.936209 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.928770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45802 (local address 127.26.23.130:33583)
0808 07:03:24.929293 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.929298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.929308 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:03:24.929347 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.929349 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.929365 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.931228 (+ 1863us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:03:24.931306 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.932344 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.933575 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.934288 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.935969 (+ 1681us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.936053 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.936079 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.936129 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":88,"threads_started":1}
I20260808 07:03:24.936271 12328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69252a8022d345ad9d124c478d85247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:03:24.936636 12869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.928481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45229 (local address 127.0.0.1:48228)
0808 07:03:24.928803 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.928844 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.928907 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.929683 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.929687 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.929690 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:03:24.929759 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.929761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.934387 (+ 4626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.934388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.935464 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.935467 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.936425 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.936426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.936490 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.936494 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.936524 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.936559 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":103,"threads_started":1}
I20260808 07:03:24.936874 12517 tablet_service.cc:1467] Processing CreateTablet for tablet 69252a8022d345ad9d124c478d85247d (DEFAULT_TABLE table=test-table [id=7308a4a85569426c9a2fa1f9f0ef3849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:03:24.937016 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.928785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.26.23.131:45229)
0808 07:03:24.929506 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.929510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.929518 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:03:24.929554 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.929556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.929571 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.929971 (+ 400us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:03:24.930049 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.931121 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.935589 (+ 4468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.936332 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.936799 (+ 467us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.936882 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.936908 (+ 26us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.936945 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":90,"threads_started":1}
I20260808 07:03:24.937208 12517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69252a8022d345ad9d124c478d85247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:03:24.940507 12879 tablet_bootstrap.cc:492] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Bootstrap starting.
I20260808 07:03:24.941932 12746 tablet_service.cc:1467] Processing CreateTablet for tablet 69252a8022d345ad9d124c478d85247d (DEFAULT_TABLE table=test-table [id=7308a4a85569426c9a2fa1f9f0ef3849]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:03:24.942301 12746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69252a8022d345ad9d124c478d85247d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:03:24.942318 12879 tablet_bootstrap.cc:654] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Neither blocks nor log segments found. Creating new log.
I20260808 07:03:24.942608 12879 log.cc:824] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:03:24.948313 12878 tablet_bootstrap.cc:492] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: Bootstrap starting.
I20260808 07:03:24.949046 12878 tablet_bootstrap.cc:654] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: Neither blocks nor log segments found. Creating new log.
I20260808 07:03:24.949391 12878 log.cc:824] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: Log is configured to *not* fsync() on all Append() calls
I20260808 07:03:24.949743 12881 tablet_bootstrap.cc:492] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Bootstrap starting.
I20260808 07:03:24.950742 12881 tablet_bootstrap.cc:654] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Neither blocks nor log segments found. Creating new log.
I20260808 07:03:24.951124 12881 log.cc:824] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Log is configured to *not* fsync() on all Append() calls
I20260808 07:03:24.951915 12879 tablet_bootstrap.cc:492] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: No bootstrap required, opened a new log
I20260808 07:03:24.951996 12879 ts_tablet_manager.cc:1397] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20260808 07:03:24.954088 12879 raft_consensus.cc:348] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.954313 12879 raft_consensus.cc:374] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:03:24.954357 12879 raft_consensus.cc:729] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e141373f00465c98634556771c4ddd, State: Initialized, Role: FOLLOWER
I20260808 07:03:24.954494 12879 consensus_queue.cc:260] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.954813 12879 ts_tablet_manager.cc:1428] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 07:03:24.954957 12646 heartbeater.cc:503] Master 127.26.23.190:39383 was elected leader, sending a full tablet report...
I20260808 07:03:24.955647 12878 tablet_bootstrap.cc:492] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: No bootstrap required, opened a new log
I20260808 07:03:24.955720 12878 ts_tablet_manager.cc:1397] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260808 07:03:24.958650 12878 raft_consensus.cc:348] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.958884 12878 raft_consensus.cc:374] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:03:24.958966 12878 raft_consensus.cc:729] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 186d40239fb44a98a9fe591ee1350e49, State: Initialized, Role: FOLLOWER
I20260808 07:03:24.959172 12878 consensus_queue.cc:260] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.959578 12878 ts_tablet_manager.cc:1428] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 07:03:24.959765 12436 heartbeater.cc:503] Master 127.26.23.190:39383 was elected leader, sending a full tablet report...
I20260808 07:03:24.960376 12881 tablet_bootstrap.cc:492] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: No bootstrap required, opened a new log
I20260808 07:03:24.960448 12881 ts_tablet_manager.cc:1397] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260808 07:03:24.962563 12881 raft_consensus.cc:348] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.962714 12881 raft_consensus.cc:374] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:03:24.962744 12881 raft_consensus.cc:729] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0533d5e10cc44608e3f852f773e6798, State: Initialized, Role: FOLLOWER
I20260808 07:03:24.962839 12881 consensus_queue.cc:260] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.963060 12881 ts_tablet_manager.cc:1428] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:03:24.963305 12845 heartbeater.cc:503] Master 127.26.23.190:39383 was elected leader, sending a full tablet report...
Aug 08 07:03:24 dist-test-slave-zj8q krb5kdc[11351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172604, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:03:24.982679 12888 raft_consensus.cc:482] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:03:24.982841 12888 raft_consensus.cc:504] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.984151 12888 leader_election.cc:288] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64e141373f00465c98634556771c4ddd (127.26.23.130:33583), 186d40239fb44a98a9fe591ee1350e49 (127.26.23.129:46123)
I20260808 07:03:24.986833 12850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.983411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:33583 (local address 127.26.23.131:44563)
0808 07:03:24.983459 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.983474 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.983518 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.983678 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.983679 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.983681 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:03:24.983759 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.983761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.984657 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.984658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.985813 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.985815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.986590 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.986591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.986672 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.986676 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.986721 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.986760 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:03:24.987301 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.983536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:44563 (local address 127.26.23.130:33583)
0808 07:03:24.983576 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.983578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.983585 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:03:24.983612 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.983613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.983623 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.983673 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:03:24.983842 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.984535 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.985932 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.986486 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.986549 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.986559 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.987190 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.987234 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:03:24.987913 12876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.984075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:38083 (local address 127.26.23.129:46123)
0808 07:03:24.984129 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:24.984131 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:24.984330 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:03:24.984419 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:24.984420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:24.984429 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:24.984455 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:03:24.984658 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.985349 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.986691 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.987253 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.987296 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.987303 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:24.987800 (+ 497us) server_negotiation.cc:299] Negotiation successful
0808 07:03:24.987846 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:03:24.988293 12889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:24.983847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:46123 (local address 127.26.23.131:38083)
0808 07:03:24.984274 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:24.984284 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:03:24.984354 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:03:24.984508 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:03:24.984508 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:03:24.984509 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:03:24.984585 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.984586 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.985440 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.985441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.986591 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:03:24.986592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:03:24.987630 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:03:24.987632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:03:24.987701 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:24.987706 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:03:24.988161 (+ 455us) client_negotiation.cc:240] Negotiation successful
0808 07:03:24.988207 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":7,"thread_start_us":103,"threads_started":1}
I20260808 07:03:24.988523 12544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69252a8022d345ad9d124c478d85247d" candidate_uuid: "f0533d5e10cc44608e3f852f773e6798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e141373f00465c98634556771c4ddd" is_pre_election: true
I20260808 07:03:24.988701 12544 raft_consensus.cc:2454] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0533d5e10cc44608e3f852f773e6798 in term 0.
I20260808 07:03:24.988704 12346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69252a8022d345ad9d124c478d85247d" candidate_uuid: "f0533d5e10cc44608e3f852f773e6798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "186d40239fb44a98a9fe591ee1350e49" is_pre_election: true
I20260808 07:03:24.988852 12346 raft_consensus.cc:2454] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0533d5e10cc44608e3f852f773e6798 in term 0.
I20260808 07:03:24.989069 12684 leader_election.cc:302] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e141373f00465c98634556771c4ddd, f0533d5e10cc44608e3f852f773e6798; no voters:
I20260808 07:03:24.989480 12888 raft_consensus.cc:2781] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:03:24.989542 12888 raft_consensus.cc:482] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:03:24.989565 12888 raft_consensus.cc:3037] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:03:24.990641 12888 raft_consensus.cc:504] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.990950 12544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69252a8022d345ad9d124c478d85247d" candidate_uuid: "f0533d5e10cc44608e3f852f773e6798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e141373f00465c98634556771c4ddd"
I20260808 07:03:24.991026 12544 raft_consensus.cc:3037] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:03:24.991873 12544 raft_consensus.cc:2454] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0533d5e10cc44608e3f852f773e6798 in term 1.
I20260808 07:03:24.992072 12684 leader_election.cc:302] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e141373f00465c98634556771c4ddd, f0533d5e10cc44608e3f852f773e6798; no voters:
I20260808 07:03:24.992451 12346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69252a8022d345ad9d124c478d85247d" candidate_uuid: "f0533d5e10cc44608e3f852f773e6798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "186d40239fb44a98a9fe591ee1350e49"
I20260808 07:03:24.992547 12346 raft_consensus.cc:3037] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:03:24.993431 12346 raft_consensus.cc:2454] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0533d5e10cc44608e3f852f773e6798 in term 1.
I20260808 07:03:24.993717 12888 leader_election.cc:288] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [CANDIDATE]: Term 1 election: Requested vote from peers 64e141373f00465c98634556771c4ddd (127.26.23.130:33583), 186d40239fb44a98a9fe591ee1350e49 (127.26.23.129:46123)
I20260808 07:03:24.993929 12888 raft_consensus.cc:2781] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:03:24.994029 12888 raft_consensus.cc:686] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 1 LEADER]: Becoming Leader. State: Replica: f0533d5e10cc44608e3f852f773e6798, State: Running, Role: LEADER
I20260808 07:03:24.994192 12888 consensus_queue.cc:237] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } }
I20260808 07:03:24.995132 12089 catalog_manager.cc:5495] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0533d5e10cc44608e3f852f773e6798 (127.26.23.131). New cstate: current_term: 1 leader_uuid: "f0533d5e10cc44608e3f852f773e6798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0533d5e10cc44608e3f852f773e6798" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45229 } health_report { overall_health: HEALTHY } } }
I20260808 07:03:25.008991 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:25.005599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.26.23.131:45229)
0808 07:03:25.005729 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 07:03:25.005731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:03:25.005736 (+ 5us) server_negotiation.cc:407] Connection header received
0808 07:03:25.005764 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:03:25.005765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:03:25.005780 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:03:25.005835 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:03:25.005980 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:25.006765 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:25.008077 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:03:25.008346 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:03:25.008414 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:03:25.008602 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:03:25.008737 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:03:25.008830 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:03:25.008895 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 07:03:25.008917 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260808 07:03:25.010746 12544 raft_consensus.cc:1261] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 1 FOLLOWER]: Refusing update from remote peer f0533d5e10cc44608e3f852f773e6798: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:03:25.010746 12346 raft_consensus.cc:1261] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 1 FOLLOWER]: Refusing update from remote peer f0533d5e10cc44608e3f852f773e6798: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:03:25.011178 12888 consensus_queue.cc:1035] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "186d40239fb44a98a9fe591ee1350e49" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:03:25.011329 12888 consensus_queue.cc:1035] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64e141373f00465c98634556771c4ddd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 33583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:03:25.015213 12896 mvcc.cc:205] Tried to move back new op lower bound from 7316162990121304064 to 7316162990057152512. Current Snapshot: MvccSnapshot[applied={T|T < 7316162990121304064}]
I20260808 07:03:25.016762 12897 mvcc.cc:205] Tried to move back new op lower bound from 7316162990121304064 to 7316162990057152512. Current Snapshot: MvccSnapshot[applied={T|T < 7316162990121304064}]
I20260808 07:03:25.017201 12899 mvcc.cc:205] Tried to move back new op lower bound from 7316162990121304064 to 7316162990057152512. Current Snapshot: MvccSnapshot[applied={T|T < 7316162990121304064}]
I20260808 07:03:25.020813 12089 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:03:25.020910 12089 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:03:25.021636 12089 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1e804f9966f04606bc07a218f58c0856: Sending DeleteTablet for 3 replicas of tablet 69252a8022d345ad9d124c478d85247d
I20260808 07:03:25.022063 12517 tablet_service.cc:1514] Processing DeleteTablet for tablet 69252a8022d345ad9d124c478d85247d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:03:25 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:45802
I20260808 07:03:25.022293 12746 tablet_service.cc:1514] Processing DeleteTablet for tablet 69252a8022d345ad9d124c478d85247d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:03:25 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:48228
I20260808 07:03:25.022682 12328 tablet_service.cc:1514] Processing DeleteTablet for tablet 69252a8022d345ad9d124c478d85247d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:03:25 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:45186
I20260808 07:03:25.022918 12911 tablet_replica.cc:330] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49: stopping tablet replica
I20260808 07:03:25.023053 12911 raft_consensus.cc:2229] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:03:25.023180 12911 raft_consensus.cc:2258] T 69252a8022d345ad9d124c478d85247d P 186d40239fb44a98a9fe591ee1350e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:03:25.023182 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 12223
I20260808 07:03:25.034293 12908 tablet_replica.cc:330] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: stopping tablet replica
I20260808 07:03:25.034509 12908 raft_consensus.cc:2229] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:03:25.034695 12908 raft_consensus.cc:2258] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:03:25.034940 12909 tablet_replica.cc:330] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: stopping tablet replica
I20260808 07:03:25.035379 12908 ts_tablet_manager.cc:1905] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:03:25.036829 12909 raft_consensus.cc:2229] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:03:25.037038 12909 raft_consensus.cc:2258] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:03:25.037528 12909 ts_tablet_manager.cc:1905] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:03:25.039048 12909 ts_tablet_manager.cc:1918] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:03:25.039202 12908 ts_tablet_manager.cc:1918] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:03:25.039307 12908 log.cc:1196] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/69252a8022d345ad9d124c478d85247d
I20260808 07:03:25.039983 12908 ts_tablet_manager.cc:1939] T 69252a8022d345ad9d124c478d85247d P 64e141373f00465c98634556771c4ddd: Deleting consensus metadata
I20260808 07:03:25.040506 12068 catalog_manager.cc:4841] TS 64e141373f00465c98634556771c4ddd (127.26.23.130:33583): tablet 69252a8022d345ad9d124c478d85247d (table test-table [id=7308a4a85569426c9a2fa1f9f0ef3849]) successfully deleted
I20260808 07:03:25.040702 12909 log.cc:1196] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/69252a8022d345ad9d124c478d85247d
I20260808 07:03:25.041040 12909 ts_tablet_manager.cc:1939] T 69252a8022d345ad9d124c478d85247d P f0533d5e10cc44608e3f852f773e6798: Deleting consensus metadata
I20260808 07:03:25.041438 12066 catalog_manager.cc:4841] TS f0533d5e10cc44608e3f852f773e6798 (127.26.23.131:45229): tablet 69252a8022d345ad9d124c478d85247d (table test-table [id=7308a4a85569426c9a2fa1f9f0ef3849]) successfully deleted
W20260808 07:03:25.042865 12067 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:46123 (error 108)
I20260808 07:03:25.043525 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 12448
I20260808 07:03:25.053755 12869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:03:25.053568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:46123 (local address 127.0.0.1:45192)
0808 07:03:25.053642 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 07:03:25.053708 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:46123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 07:03:25.054034 12067 catalog_manager.cc:4584] TS 186d40239fb44a98a9fe591ee1350e49 (127.26.23.129:46123): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 69252a8022d345ad9d124c478d85247d: Network error: Client connection negotiation failed: client connection to 127.26.23.129:46123: connect: Connection refused (error 111)
I20260808 07:03:25.065641 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 12652
I20260808 07:03:25.081748 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 12038
I20260808 07:03:25.096760 26718 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 07:03:25.441598 26718 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 07:03:25.441713 26718 mini_ranger.cc:66] Stopping Ranger...
I20260808 07:03:25.785616 26718 mini_ranger.cc:68] Stopped Ranger
2026-08-08 07:03:25.785 UTC [11391] LOG: received smart shutdown request
2026-08-08 07:03:25.789 UTC [11391] LOG: background worker "logical replication launcher" (PID 11405) exited with exit code 1
2026-08-08 07:03:25.789 UTC [11397] LOG: shutting down
2026-08-08 07:03:25.931 UTC [11391] LOG: database system is shut down
2026-08-08T07:03:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (43615 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:03:26 dist-test-slave-zj8q krb5kdc[12931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:03:26 dist-test-slave-zj8q krb5kdc[12931](info): set up 2 sockets
Aug 08 07:03:26 dist-test-slave-zj8q krb5kdc[12931](info): commencing operation
krb5kdc: starting...
W20260808 07:03:27.178054 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:03:27 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:03:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:03:27Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/rangeradmin_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/rangeradmin_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/rangerlookup_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/rangerlookup_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
I20260808 07:03:27.334236 26718 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGJ9A1U/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/postgres -l logfile start
2026-08-08 07:03:29.561 UTC [12972] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 07:03:29.561 UTC [12972] LOG: listening on IPv4 address "127.26.23.148", port 49231
2026-08-08 07:03:29.564 UTC [12972] LOG: listening on Unix socket "/tmp/.s.PGSQL.49231"
2026-08-08 07:03:29.592 UTC [12977] LOG: database system was shut down at 2026-08-08 07:03:28 UTC
2026-08-08 07:03:29.596 UTC [12972] LOG: database system is ready to accept connections
I20260808 07:03:30.658278 26718 mini_postgres.cc:96] Postgres bound to 49231
2026-08-08 07:03:30.665 UTC [12988] FATAL: database "slave" does not exist
127.26.23.148:49231 - accepting connections
I20260808 07:03:30.665432 26718 mini_ranger.cc:161] Starting Ranger...
I20260808 07:03:30.680120 26718 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 07:03:31.095908 26718 mini_ranger.cc:87] Created ranger Postgres database
I20260808 07:03:31.095983 26718 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-admin
2026-08-08 07:03:31,362 [I] DB FLAVOR :POSTGRES
2026-08-08 07:03:31,363 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:03:31,363 [I] Checking connection..
2026-08-08 07:03:31,363 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 07:03:31,618 [I] Checking connection passed.
2026-08-08 07:03:31,619 [I] --------- Verifying version history table ---------
2026-08-08 07:03:31,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:03:31,881 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:03:31,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:03:32,142 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 07:03:32,142 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 07:03:32,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 07:03:32.390 UTC [13075] WARNING: there is no transaction in progress
2026-08-08 07:03:32,396 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 07:03:32,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 07:03:32,653 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 07:03:32,653 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:03:32,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 07:03:32,905 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 07:03:33,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-zj8q.c.gcp-upstream.internal','N') ;"
2026-08-08 07:03:33,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:03:33,649 [I] Table x_portal_user does not exist in database ranger
2026-08-08 07:03:33,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:03:33,909 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 07:03:33,909 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:03:34,140 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:03:34,386 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 07:03:34,387 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 07:03:35.276 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.291 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.306 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.319 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.333 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.350 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.398 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.404 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.417 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.426 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.435 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.447 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.456 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.461 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.467 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:35.473 UTC [13234] WARNING: there is no transaction in progress
2026-08-08 07:03:36,041 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 07:03:36,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 07:03:36,268 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 07:03:36,269 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 07:03:36,523 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 07:03:36,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 07:03:36,775 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 07:03:36,776 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 07:03:37,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 07:03:37,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-zj8q.c.gcp-upstream.internal';"
2026-08-08 07:03:37,520 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 07:03:37,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 07:03:37,776 [I] DB_PATCHES have already been applied
I20260808 07:03:37.781898 26718 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGJ9A1U/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 07:03:37.781960 26718 mini_ranger.cc:193] Using host: 127.26.23.148
I20260808 07:03:37.785730 26718 mini_ranger.cc:227] Ranger admin URL: http://127.26.23.148:36245
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 7:03:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 07:03:38.995705 26718 mini_ranger.cc:160] Time spent starting Ranger: real 8.330s user 0.000s sys 0.009s
Aug 08, 2026 7:03:57 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 7:03:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 7:03:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 7:03:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 7:03:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 07:03:59.379606 26718 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.26.23.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.26.23.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/rangerkms_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.26.23.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/rangerkms_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.26.23.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.26.23.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.26.23.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/HTTP_127.26.23.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 07:03:59 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172639, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 07:03:59.459512 26718 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 07:03:59.469029 26718 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 07:04:00.232285 26718 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 07:04:00.232379 26718 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms
I20260808 07:04:00.232398 26718 mini_ranger_kms.cc:227] Using postgres at 127.26.23.148:49231
2026-08-08 07:04:00,430 [I] DB FLAVOR :POSTGRES
2026-08-08 07:04:00,430 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 07:04:00,430 [I] Checking connection
2026-08-08 07:04:00,430 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 07:04:00,694 [I] connection success
2026-08-08 07:04:00,695 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 07:04:00,695 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 07:04:00,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 07:04:00,988 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 07:04:00,988 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 07:04:00,988 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 07:04:00,988 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.26.23.148:49231/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 07:04:01,256 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 07:04:01.691932 26718 mini_ranger_kms.cc:310] Created kms service
I20260808 07:04:01.860145 26718 mini_ranger_kms.cc:326] Created kudu user
I20260808 07:04:01.900348 26718 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 07:04:01 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172639, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:02.286932 26718 mini_ranger_kms.cc:384] Added ranger policy
I20260808 07:04:02.287177 26718 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGJ9A1U/build/release/bin/postgresql.jar:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGJ9A1U/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 07:04:02.287209 26718 mini_ranger_kms.cc:240] Using host: 127.26.23.148
I20260808 07:04:02.291170 26718 mini_ranger_kms.cc:276] Ranger KMS PID: 13506
I20260808 07:04:02.291257 26718 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.26.23.148:47939
Aug 08, 2026 7:04:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 7:04:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 7:04:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 7:04:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 7:04:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 7:04:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 07:04:05 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172645, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.23.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:05.564649 26718 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.105s user 0.007s sys 0.176s
I20260808 07:04:05.564735 26718 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 07:04:05.564785 26718 mini_ranger_kms.cc:401] 127.26.23.148:47939/kms/v1/keys
Aug 08 07:04:05 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172645, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.23.148@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
Aug 08 07:04:06 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172645, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.26.23.148@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
Aug 08 07:04:08 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:04:08.374440 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33345
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:33345
--ranger_config_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:08.456532 13577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:08.456727 13577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:08.456748 13577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:08.457864 13577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:08.457906 13577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:08.457918 13577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:08.457929 13577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:08.457940 13577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:08.459554 13577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
--ranger_kms_url=127.26.23.148:47939/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:33345
--ranger_config_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:08.459779 13577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:08.460055 13577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:08.465085 13588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:08.465176 13586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:08.465088 13577 server_base.cc:1034] running on GCE node
W20260808 07:04:08.465088 13591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:08.465449 13577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:08.465750 13577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:08.466895 13577 hybrid_clock.cc:648] HybridClock initialized: now 1786172648466881 us; error 31 us; skew 500 ppm
Aug 08 07:04:08 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172648, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:08.469283 13577 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:08.469691 13577 webserver.cc:460] Webserver started at http://127.26.23.190:35349/ using document root <none> and password file <none>
I20260808 07:04:08.469895 13577 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:08.469933 13577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:08.470050 13577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:04:08 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172648, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:08.516186 13577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "47f4f88d94b846f7956ed6311ca472f0"
format_stamp: "Formatted at 2026-08-08 07:04:08 on dist-test-slave-zj8q"
server_key: "6dd1ba9798017093181ecea16dd13e07"
server_key_iv: "c4b931b3b7932536f12440cd8f379c00"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:08.516659 13577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "47f4f88d94b846f7956ed6311ca472f0"
format_stamp: "Formatted at 2026-08-08 07:04:08 on dist-test-slave-zj8q"
server_key: "6dd1ba9798017093181ecea16dd13e07"
server_key_iv: "c4b931b3b7932536f12440cd8f379c00"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:08.518234 13577 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:04:08.532171 13600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:08.532402 13577 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:08.532513 13577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "47f4f88d94b846f7956ed6311ca472f0"
format_stamp: "Formatted at 2026-08-08 07:04:08 on dist-test-slave-zj8q"
server_key: "6dd1ba9798017093181ecea16dd13e07"
server_key_iv: "c4b931b3b7932536f12440cd8f379c00"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:08.532616 13577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:08.549032 13577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:08.551071 13577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:08.551235 13577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:08.555428 13577 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:33345
I20260808 07:04:08.555485 13673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:33345 every 8 connection(s)
I20260808 07:04:08.555830 13577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:08.556499 13676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:08.558815 13676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Bootstrap starting.
I20260808 07:04:08.559406 13676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:08.559679 13676 log.cc:824] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:08.559995 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 13577
I20260808 07:04:08.560094 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:04:08.560281 26718 external_mini_cluster.cc:1428] Setting key 47fb90bdb22b5ab93234e48b47fb142d
I20260808 07:04:08.560443 13676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: No bootstrap required, opened a new log
I20260808 07:04:08.563509 13676 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:08.563719 13676 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:08.563794 13676 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f4f88d94b846f7956ed6311ca472f0, State: Initialized, Role: FOLLOWER
I20260808 07:04:08.563962 13676 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:08.564050 13676 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:08.564082 13676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:08.564150 13676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:08.564915 13676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:08.565033 13676 leader_election.cc:302] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47f4f88d94b846f7956ed6311ca472f0; no voters:
I20260808 07:04:08.565270 13676 leader_election.cc:288] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:04:08.565320 13686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:08.565510 13686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 LEADER]: Becoming Leader. State: Replica: 47f4f88d94b846f7956ed6311ca472f0, State: Running, Role: LEADER
I20260808 07:04:08.565656 13676 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:08.565690 13686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:08.566169 13686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47f4f88d94b846f7956ed6311ca472f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } } }
I20260808 07:04:08.566314 13686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:08.566501 13686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47f4f88d94b846f7956ed6311ca472f0. Latest consensus state: current_term: 1 leader_uuid: "47f4f88d94b846f7956ed6311ca472f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } } }
I20260808 07:04:08.566617 13686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:08.566792 13705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:08.567333 13705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:04:08 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:08.567687 13676 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:04:08.574139 13714 mvcc.cc:205] Tried to move back new op lower bound from 7316163168549666816 to 7316163168525860864. Current Snapshot: MvccSnapshot[applied={T|T < 7316163168549666816}]
I20260808 07:04:08.574723 13684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:08.560782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48706 (local address 127.26.23.190:33345)
0808 07:04:08.561042 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:08.561050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:08.561073 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:04:08.561827 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:08.561834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:08.561885 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:08.562015 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:08.562707 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:08.563595 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:08.564535 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:08.564956 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:08.565116 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:08.567897 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:08.567902 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:08.567902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:08.567914 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:08.572550 (+ 4636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:08.572967 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:08.572970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:08.572970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:08.573085 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:08.573282 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:08.573282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:08.573283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:08.573637 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:08.573803 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:08.574320 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 07:04:08.574492 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":78,"threads_started":1}
I20260808 07:04:08.578647 13705 catalog_manager.cc:1347] Generated new cluster ID: 9ab0d4d51ce242bfa01c21317444eb9d
I20260808 07:04:08.578698 13705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:08.585155 13705 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:04:08.585944 13705 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:08.600929 13705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Generated new TSK 0
I20260808 07:04:08.601300 13705 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:04:09.299011 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33345
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:09.386267 13753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:09.386457 13753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:09.386488 13753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:09.387601 13753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:09.387641 13753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:09.387676 13753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:09.389094 13753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.26.23.148:47939/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:09.389304 13753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:09.389513 13753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:09.395502 13764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:09.395495 13765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:09.395751 13768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:09.395840 13753 server_base.cc:1034] running on GCE node
I20260808 07:04:09.396042 13753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:09.396268 13753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:09.397411 13753 hybrid_clock.cc:648] HybridClock initialized: now 1786172649397396 us; error 29 us; skew 500 ppm
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:09.399868 13753 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:09.400331 13753 webserver.cc:460] Webserver started at http://127.26.23.129:34563/ using document root <none> and password file <none>
I20260808 07:04:09.400540 13753 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:09.400594 13753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:09.400719 13753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:09.416452 13753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "069c0f35489d41a796801b4184b28381"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "fa16e48253e5e8b598399a8cac45c82e"
server_key_iv: "2a54f3734ac2d4cbdad72de98eeb69b7"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.416836 13753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "069c0f35489d41a796801b4184b28381"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "fa16e48253e5e8b598399a8cac45c82e"
server_key_iv: "2a54f3734ac2d4cbdad72de98eeb69b7"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.418550 13753 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:09.430301 13777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.430483 13753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:09.430601 13753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "069c0f35489d41a796801b4184b28381"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "fa16e48253e5e8b598399a8cac45c82e"
server_key_iv: "2a54f3734ac2d4cbdad72de98eeb69b7"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.430686 13753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:09.443436 13753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:09.445320 13753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:09.445458 13753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:09.445694 13753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:09.446041 13753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:09.446084 13753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.446112 13753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:09.446171 13753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.453053 13753 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:46575
I20260808 07:04:09.453140 13958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:46575 every 8 connection(s)
I20260808 07:04:09.453423 13753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:04:09.455504 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 13753
I20260808 07:04:09.455614 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:04:09.455790 26718 external_mini_cluster.cc:1428] Setting key d03ccea879cfc29fb213b0a6866fe204
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:09.463340 13966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:09.454181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36693 (local address 127.26.23.190:33345)
0808 07:04:09.454905 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:09.454907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:09.454913 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:04:09.454934 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:09.454935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:09.454945 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:09.455003 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:09.455679 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.456413 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.457432 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.457648 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.457704 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:09.459905 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:09.459907 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:09.459907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:09.459915 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:09.461603 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:09.462226 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:09.462227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:09.462228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:09.462303 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:09.462598 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:09.462599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:09.462600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:09.462745 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:09.462819 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:09.463138 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 07:04:09.463227 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":130,"threads_started":1}
I20260808 07:04:09.463495 13964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:09.454089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33345 (local address 127.26.23.129:36693)
0808 07:04:09.454265 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:09.454307 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:09.454768 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:09.455103 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:09.455108 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:09.455285 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:09.455572 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:09.455580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.456538 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.456539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:09.457351 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:09.457353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.457740 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.457741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:09.457851 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:09.458312 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:09.458323 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:09.459817 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:09.461692 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:09.461699 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:09.461702 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:09.462010 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:09.462378 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:09.462379 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:09.462380 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:09.462522 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:09.462816 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:09.462823 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:09.462986 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 07:04:09.463107 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 07:04:09.463270 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
I20260808 07:04:09.463954 13960 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33345
I20260808 07:04:09.464042 13960 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:09.464217 13960 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:09.464766 13623 ts_manager.cc:194] Registered new tserver with Master: 069c0f35489d41a796801b4184b28381 (127.26.23.129:46575)
I20260808 07:04:09.465646 13623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:36693
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:04:09.488368 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33345
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:09.606169 13973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:09.606453 13973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:09.606495 13973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:09.608206 13973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:09.608268 13973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:09.608306 13973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:09.610489 13973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.26.23.148:47939/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:09.610738 13973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:09.611040 13973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:09.617543 13990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:09.617612 13987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:09.617969 13988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:09.618479 13973 server_base.cc:1034] running on GCE node
I20260808 07:04:09.618712 13973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:09.618993 13973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:09.620177 13973 hybrid_clock.cc:648] HybridClock initialized: now 1786172649620150 us; error 40 us; skew 500 ppm
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:09.623442 13973 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:09.623937 13973 webserver.cc:460] Webserver started at http://127.26.23.130:42487/ using document root <none> and password file <none>
I20260808 07:04:09.624222 13973 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:09.624287 13973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:09.624435 13973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:09.638232 13973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "27d6cc61b8ec4b95a62370a93b77716d"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "c714d25a1f44787a3eccd8415ec6fa83"
server_key_iv: "0daef74ad234f093bc7ce8e128aa52c8"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.638705 13973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "27d6cc61b8ec4b95a62370a93b77716d"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "c714d25a1f44787a3eccd8415ec6fa83"
server_key_iv: "0daef74ad234f093bc7ce8e128aa52c8"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.646611 13973 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.002s
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:09.660266 14001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.660887 13973 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:09.660997 13973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "27d6cc61b8ec4b95a62370a93b77716d"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "c714d25a1f44787a3eccd8415ec6fa83"
server_key_iv: "0daef74ad234f093bc7ce8e128aa52c8"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.661094 13973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:09.676728 13973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:09.682732 13973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:09.683223 13973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:09.684461 13973 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:09.684908 13973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:09.684999 13973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.685072 13973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:09.685139 13973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.696143 13973 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:45413
I20260808 07:04:09.696532 13973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:04:09.697835 14188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:45413 every 8 connection(s)
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:09.706000 13966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:09.698458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:32821 (local address 127.26.23.190:33345)
0808 07:04:09.698505 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:09.698508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:09.698727 (+ 219us) server_negotiation.cc:407] Connection header received
0808 07:04:09.699243 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:09.699244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:09.699263 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:09.699313 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:09.699859 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.700363 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.701334 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.701534 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.701589 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:09.703512 (+ 1923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:09.703513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:09.703514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:09.703520 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:09.704767 (+ 1247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:09.705118 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:09.705120 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:09.705120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:09.705177 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:09.705388 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:09.705389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:09.705389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:09.705499 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:09.705568 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:09.705817 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 07:04:09.705908 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:04:09.706231 14193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:09.698445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33345 (local address 127.26.23.130:32821)
0808 07:04:09.698609 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:09.698651 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:09.699148 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:09.699382 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:09.699386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:09.699576 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:09.699769 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:09.699773 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.700446 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.700448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:09.701252 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:09.701255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.701621 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.701622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:09.701740 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:09.702229 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:09.702238 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:09.703426 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:09.704842 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:09.704848 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:09.704851 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:09.705052 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:09.705232 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:09.705233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:09.705234 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:09.705332 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:09.705569 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:09.705576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:09.705701 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 07:04:09.705788 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:04:09.705923 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":95,"threads_started":1}
I20260808 07:04:09.706575 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 13973
I20260808 07:04:09.706683 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:04:09.706729 14191 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33345
I20260808 07:04:09.706807 14191 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:09.706907 26718 external_mini_cluster.cc:1428] Setting key ed3ef870356e525014e6f26b74ecd0a9
I20260808 07:04:09.706980 14191 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:09.707320 13623 ts_manager.cc:194] Registered new tserver with Master: 27d6cc61b8ec4b95a62370a93b77716d (127.26.23.130:45413)
I20260808 07:04:09.707770 13623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:32821
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:04:09.740581 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33345
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:09.877291 14202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:09.877627 14202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:09.877710 14202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:09.879558 14202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:09.879662 14202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:09.879741 14202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:09.881840 14202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.26.23.148:47939/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:33345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:09.882390 14202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:09.882694 14202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:09.889436 14208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:09.889683 14214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:09.890291 14209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:09.890393 14202 server_base.cc:1034] running on GCE node
I20260808 07:04:09.890690 14202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:09.890934 14202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:09.892105 14202 hybrid_clock.cc:648] HybridClock initialized: now 1786172649892084 us; error 36 us; skew 500 ppm
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:09.895368 14202 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:09.895838 14202 webserver.cc:460] Webserver started at http://127.26.23.131:37873/ using document root <none> and password file <none>
I20260808 07:04:09.896096 14202 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:09.896157 14202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:09.896276 14202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:09.918025 14202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "024cb4c3ddf541c7add7653ed78e94c4"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "5dcf5799eb6eccd1a761d6f1ccd447a8"
server_key_iv: "2676059c041e4a0ca7765a020ad5d1ae"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.918567 14202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "024cb4c3ddf541c7add7653ed78e94c4"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "5dcf5799eb6eccd1a761d6f1ccd447a8"
server_key_iv: "2676059c041e4a0ca7765a020ad5d1ae"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.922250 14202 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 07:04:09.936297 14225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.937317 14202 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:09.937436 14202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "024cb4c3ddf541c7add7653ed78e94c4"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "5dcf5799eb6eccd1a761d6f1ccd447a8"
server_key_iv: "2676059c041e4a0ca7765a020ad5d1ae"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:09.937552 14202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:09.954370 14202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:09.956553 14202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:09.956691 14202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:09.956940 14202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:09.957283 14202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:09.957324 14202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.957353 14202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:09.957415 14202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:09.964500 14202 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:39963
I20260808 07:04:09.964628 14392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:39963 every 8 connection(s)
I20260808 07:04:09.965133 14202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:04:09.971446 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 14202
I20260808 07:04:09.971550 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:04:09.971740 26718 external_mini_cluster.cc:1428] Setting key 77e57db3c144e6fb8d4bfcdbe6fe6d82
Aug 08 07:04:09 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172649, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:09.975895 13966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:09.966009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:59017 (local address 127.26.23.190:33345)
0808 07:04:09.966058 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:09.966060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:09.966368 (+ 308us) server_negotiation.cc:407] Connection header received
0808 07:04:09.967054 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:09.967057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:09.967071 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:09.967150 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:09.967858 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.968520 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.969928 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.970302 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.970369 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:09.972786 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:09.972788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:09.972788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:09.972796 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:09.974348 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:09.974799 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:09.974800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:09.974800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:09.974919 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:09.975207 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:09.975209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:09.975209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:09.975353 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:09.975420 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:09.975721 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 07:04:09.975806 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:04:09.976075 14395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:09.965991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33345 (local address 127.26.23.131:59017)
0808 07:04:09.966230 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:09.966280 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:09.966935 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:09.967229 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:09.967233 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:09.967481 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:09.967761 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:09.967768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.968623 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.968624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:09.969832 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:09.969835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:09.970437 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:09.970439 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:09.970590 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:09.971108 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:09.971117 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:09.972699 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:09.974425 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:09.974432 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:09.974435 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:09.974728 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:09.974991 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:09.974992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:09.974992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:09.975139 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:09.975416 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:09.975422 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:09.975580 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 07:04:09.975690 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 07:04:09.975843 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":151,"threads_started":1}
I20260808 07:04:09.976728 14393 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33345
I20260808 07:04:09.976826 14393 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:09.977017 14393 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:09.977444 13623 ts_manager.cc:194] Registered new tserver with Master: 024cb4c3ddf541c7add7653ed78e94c4 (127.26.23.131:39963)
I20260808 07:04:09.977945 13623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:59017
I20260808 07:04:09.983506 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:04:09.984236 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 13753
I20260808 07:04:09.998298 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 13973
I20260808 07:04:10.047310 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 14202
I20260808 07:04:10.056951 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 13577
I20260808 07:04:10.073503 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33345
--webserver_interface=127.26.23.190
--webserver_port=35349
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:33345
--ranger_config_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:10.188973 14397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:10.189253 14397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:10.189283 14397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:10.190934 14397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:10.190987 14397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:10.191007 14397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:10.191023 14397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:10.191039 14397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:10.193267 14397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:33345
--ranger_config_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=35349
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:10.193506 14397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:10.193743 14397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:10.198637 14405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:10.198618 14404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:10.198798 14397 server_base.cc:1034] running on GCE node
W20260808 07:04:10.198647 14407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:10.199290 14397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:10.199609 14397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:10.200776 14397 hybrid_clock.cc:648] HybridClock initialized: now 1786172650200756 us; error 39 us; skew 500 ppm
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:10.203648 14397 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:10.204140 14397 webserver.cc:460] Webserver started at http://127.26.23.190:35349/ using document root <none> and password file <none>
I20260808 07:04:10.204380 14397 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:10.204443 14397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:10.272380 14397 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:10.273241 14418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.273422 14397 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:10.273515 14397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "47f4f88d94b846f7956ed6311ca472f0"
format_stamp: "Formatted at 2026-08-08 07:04:08 on dist-test-slave-zj8q"
server_key: "6dd1ba9798017093181ecea16dd13e07"
server_key_iv: "c4b931b3b7932536f12440cd8f379c00"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:10.273985 14397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:10.300307 14397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:10.302178 14397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:10.302299 14397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:10.306334 14397 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:33345
I20260808 07:04:10.306392 14494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:33345 every 8 connection(s)
I20260808 07:04:10.306761 14397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:10.307991 14495 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:04:10.308645 14495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Bootstrap starting.
I20260808 07:04:10.310591 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 14397
I20260808 07:04:10.310933 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:46575
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:33345
--webserver_port=34563
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:10.316954 14495 log.cc:824] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:10.318663 14495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:10.318907 14495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Bootstrap complete.
I20260808 07:04:10.321095 14495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:10.321339 14495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f4f88d94b846f7956ed6311ca472f0, State: Initialized, Role: FOLLOWER
I20260808 07:04:10.321491 14495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:10.321575 14495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:10.321624 14495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:10.321681 14495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:04:10.322726 14495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:10.322845 14495 leader_election.cc:302] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47f4f88d94b846f7956ed6311ca472f0; no voters:
I20260808 07:04:10.322991 14495 leader_election.cc:288] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:04:10.323040 14501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:04:10.323184 14501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [term 2 LEADER]: Becoming Leader. State: Replica: 47f4f88d94b846f7956ed6311ca472f0, State: Running, Role: LEADER
I20260808 07:04:10.323272 14495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:10.323354 14501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } }
I20260808 07:04:10.323674 14502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "47f4f88d94b846f7956ed6311ca472f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } } }
I20260808 07:04:10.323748 14502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:10.323908 14503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47f4f88d94b846f7956ed6311ca472f0. Latest consensus state: current_term: 2 leader_uuid: "47f4f88d94b846f7956ed6311ca472f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47f4f88d94b846f7956ed6311ca472f0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33345 } } }
I20260808 07:04:10.323990 14503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:10.324787 14495 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 07:04:10.327109 14514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:10.328168 14514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:04:10.328586 14514 catalog_manager.cc:1259] Loaded cluster ID: 9ab0d4d51ce242bfa01c21317444eb9d
I20260808 07:04:10.328693 14514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:10.330222 14514 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:10.330493 14514 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Loaded TSK: 0
I20260808 07:04:10.330785 14514 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:04:10.421383 14497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:10.421661 14497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:10.421700 14497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:10.423348 14497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:10.423436 14497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:10.423493 14497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:10.425561 14497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:46575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=34563
--tserver_master_addrs=127.26.23.190:33345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:10.425801 14497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:10.426097 14497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:10.432626 14564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:10.432641 14562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:10.432987 14560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:10.434064 14497 server_base.cc:1034] running on GCE node
I20260808 07:04:10.434350 14497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:10.434607 14497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:10.435792 14497 hybrid_clock.cc:648] HybridClock initialized: now 1786172650435760 us; error 45 us; skew 500 ppm
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:10.439034 14497 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:10.439551 14497 webserver.cc:460] Webserver started at http://127.26.23.129:34563/ using document root <none> and password file <none>
I20260808 07:04:10.439806 14497 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:10.439898 14497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:10.468500 14497 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:10.469452 14575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.469619 14497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:10.469725 14497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "069c0f35489d41a796801b4184b28381"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "fa16e48253e5e8b598399a8cac45c82e"
server_key_iv: "2a54f3734ac2d4cbdad72de98eeb69b7"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:10.470943 14497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:10.482483 14497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:10.484884 14497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:10.485091 14497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:10.485394 14497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:10.485839 14497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:10.485930 14497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.486029 14497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:10.486102 14497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.492105 14497 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:46575
I20260808 07:04:10.492578 14497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:04:10.496942 14745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:46575 every 8 connection(s)
I20260808 07:04:10.497967 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 14497
I20260808 07:04:10.498315 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:45413
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:33345
--webserver_port=42487
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:10.509519 14749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.493604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33345 (local address 127.26.23.129:33187)
0808 07:04:10.494714 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:10.494764 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:10.495415 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:10.496132 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:10.496137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:10.496371 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:10.496666 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:10.496673 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.500750 (+ 4077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.500752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:10.502055 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:10.502059 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.503044 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.503046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:10.503188 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.503791 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:10.503802 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:10.505397 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:10.507612 (+ 2215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:10.507618 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:10.507621 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:10.507919 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:10.508206 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:10.508207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:10.508207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:10.508342 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:10.508845 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:10.508851 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:10.509008 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:04:10.509120 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:04:10.509283 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"thread_start_us":544,"threads_started":1}
I20260808 07:04:10.510068 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.494472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:33187 (local address 127.26.23.190:33345)
0808 07:04:10.495617 (+ 1145us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:10.495638 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:10.495672 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:04:10.495829 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:10.495836 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:10.495896 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:10.496039 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:10.496823 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.500616 (+ 3793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.502182 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.502824 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.502929 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.505550 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:10.505554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:10.505555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:10.505568 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:10.507498 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.508011 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.508014 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.508015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.508126 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.508415 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.508416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.508416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.508731 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:10.508805 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:10.509735 (+ 930us) server_negotiation.cc:299] Negotiation successful
0808 07:04:10.509861 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1092,"thread_start_us":97,"threads_started":1}
I20260808 07:04:10.510901 14747 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33345
I20260808 07:04:10.511004 14747 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.511198 14747 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
W20260808 07:04:10.512142 14747 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:33345 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:04:10.512218 14747 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.512280 14747 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:10.512734 14747 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.512809 14747 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
W20260808 07:04:10.513177 14747 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:04:10.613902 14751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:10.614100 14751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:10.614123 14751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:10.615283 14751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:10.615324 14751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:10.615350 14751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:10.617105 14751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:45413
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=42487
--tserver_master_addrs=127.26.23.190:33345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:10.617352 14751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:10.617586 14751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:10.623726 14765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:10.623739 14764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:10.623958 14767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:10.624200 14751 server_base.cc:1034] running on GCE node
I20260808 07:04:10.624405 14751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:10.624632 14751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:10.625803 14751 hybrid_clock.cc:648] HybridClock initialized: now 1786172650625790 us; error 27 us; skew 500 ppm
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:10.628822 14751 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:10.629330 14751 webserver.cc:460] Webserver started at http://127.26.23.130:42487/ using document root <none> and password file <none>
I20260808 07:04:10.629616 14751 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:10.629714 14751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:10.646469 14751 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:04:10.647410 14779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.647617 14751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:04:10.647735 14751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "27d6cc61b8ec4b95a62370a93b77716d"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "c714d25a1f44787a3eccd8415ec6fa83"
server_key_iv: "0daef74ad234f093bc7ce8e128aa52c8"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:10.648212 14751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:10.674955 14751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:10.677173 14751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:10.677330 14751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:10.677657 14751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:10.678066 14751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:10.678118 14751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.678180 14751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:10.678249 14751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.685884 14751 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:45413
I20260808 07:04:10.685954 14965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:45413 every 8 connection(s)
I20260808 07:04:10.686443 14751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:04:10.690135 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 14751
I20260808 07:04:10.690428 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.26.23.148:47939/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:39963
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:33345
--webserver_port=37873
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:10.697203 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.687217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:54307 (local address 127.26.23.190:33345)
0808 07:04:10.687272 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:10.687274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:10.687467 (+ 193us) server_negotiation.cc:407] Connection header received
0808 07:04:10.688063 (+ 596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:10.688065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:10.688079 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:10.688168 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:10.688707 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.689458 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.690660 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.690974 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.691050 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.693306 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:10.693308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:10.693309 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:10.693317 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:10.695560 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.696076 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.696077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.696078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.696143 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.696431 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.696432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.696432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.696571 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:10.696617 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:10.697017 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 07:04:10.697106 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:04:10.697955 14968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.687182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33345 (local address 127.26.23.130:54307)
0808 07:04:10.687336 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:10.687377 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:10.687948 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:10.688222 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:10.688225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:10.688414 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:10.688606 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:10.688611 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.689539 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.689540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:10.690568 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:10.690572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.691085 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.691086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:10.691241 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.691881 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:10.691891 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:10.693220 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:10.695669 (+ 2449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:10.695677 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:10.695679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:10.695981 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:10.696215 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:10.696215 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:10.696216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:10.696354 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:10.696681 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:10.696688 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:10.696857 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 07:04:10.697546 (+ 689us) client_negotiation.cc:240] Negotiation successful
0808 07:04:10.697725 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260808 07:04:10.698750 14966 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33345
I20260808 07:04:10.698838 14966 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.699021 14966 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
W20260808 07:04:10.699707 14966 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:33345 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:04:10.699775 14966 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.699837 14966 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:10.700203 14966 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.700273 14966 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
W20260808 07:04:10.700598 14966 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:04:10.793475 14969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:10.793706 14969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:10.793738 14969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:10.795053 14969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:10.795101 14969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:10.795145 14969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:10.796577 14969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.26.23.148:47939/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:39963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=37873
--tserver_master_addrs=127.26.23.190:33345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:10.796799 14969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:10.797004 14969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:10.802172 14980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:10.802291 14969 server_base.cc:1034] running on GCE node
W20260808 07:04:10.802189 14986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:10.802189 14979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:10.802551 14969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:10.802767 14969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:10.803908 14969 hybrid_clock.cc:648] HybridClock initialized: now 1786172650803894 us; error 32 us; skew 500 ppm
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:10.806640 14969 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:10.807154 14969 webserver.cc:460] Webserver started at http://127.26.23.131:37873/ using document root <none> and password file <none>
I20260808 07:04:10.807392 14969 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:10.807452 14969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:10.823311 14969 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 07:04:10.824427 14998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.824697 14969 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:10.824813 14969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "024cb4c3ddf541c7add7653ed78e94c4"
format_stamp: "Formatted at 2026-08-08 07:04:09 on dist-test-slave-zj8q"
server_key: "5dcf5799eb6eccd1a761d6f1ccd447a8"
server_key_iv: "2676059c041e4a0ca7765a020ad5d1ae"
server_key_version: "kuduclusterkey@0"
I20260808 07:04:10.825304 14969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:10.855510 14969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:10.857933 14969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:10.858107 14969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:10.858407 14969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:10.858803 14969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:10.858853 14969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.858884 14969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:10.858949 14969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:10.866333 14969 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:39963
I20260808 07:04:10.866737 14969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:04:10.867236 15194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:39963 every 8 connection(s)
I20260808 07:04:10.868813 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 14969
Aug 08 07:04:10 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172650, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:10.877768 15197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.867455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:33345 (local address 127.26.23.131:50387)
0808 07:04:10.867614 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:10.867656 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:10.868134 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:10.868370 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:10.868374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:10.868560 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:10.868767 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:10.868771 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.869630 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.869632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:10.870943 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:10.870947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.871552 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.871554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:10.871855 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.872419 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:10.872429 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:10.873735 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:10.875560 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:10.875573 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:10.875576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:10.875886 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:10.876119 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:10.876120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:10.876121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:10.876554 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:10.877110 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:10.877117 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:10.877280 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 07:04:10.877385 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 07:04:10.877536 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260808 07:04:10.878090 14750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.867440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:50387 (local address 127.26.23.190:33345)
0808 07:04:10.867490 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:10.867492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:10.867736 (+ 244us) server_negotiation.cc:407] Connection header received
0808 07:04:10.868233 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:10.868235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:10.868249 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:10.868300 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:10.868857 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.869536 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.871050 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.871355 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.871454 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.873822 (+ 2368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:10.873824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:10.873824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:10.873832 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:10.875460 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.875960 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.875961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.875962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.876029 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.876635 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.876636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.876637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.877004 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:10.877081 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:10.877912 (+ 831us) server_negotiation.cc:299] Negotiation successful
0808 07:04:10.877993 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:04:10.878482 15195 heartbeater.cc:347] Connected to a master server at 127.26.23.190:33345
I20260808 07:04:10.878572 15195 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.878775 15195 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:10.879410 15200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:10.869387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48708 (local address 127.26.23.190:33345)
0808 07:04:10.869481 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:10.869483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:10.869490 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:04:10.869527 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:10.869528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:10.869538 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:10.869599 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:10.872040 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.872690 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.873905 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:10.874198 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:10.874259 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:10.875998 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:10.876000 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:10.876000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:10.876008 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:10.877583 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.878294 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.878295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.878296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.878361 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:10.878615 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:10.878616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:10.878616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:10.878752 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:10.878919 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:10.879235 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 07:04:10.879321 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":52,"threads_started":1}
W20260808 07:04:10.879530 15195 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:33345 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 07:04:10.879590 15195 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.879644 15195 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:10.879980 15195 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:10.880056 15195 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
W20260808 07:04:10.880347 15195 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 07:04:11 dist-test-slave-zj8q krb5kdc[12931](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786172651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:11.513338 14747 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:11.513484 14747 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:11.513864 14445 ts_manager.cc:194] Registered new tserver with Master: 069c0f35489d41a796801b4184b28381 (127.26.23.129:46575)
I20260808 07:04:11.514902 14445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:33187
I20260808 07:04:11.700764 14966 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:11.700911 14966 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:11.701177 14445 ts_manager.cc:194] Registered new tserver with Master: 27d6cc61b8ec4b95a62370a93b77716d (127.26.23.130:45413)
I20260808 07:04:11.701699 14445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:54307
Aug 08 07:04:11 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
I20260808 07:04:11.880517 15195 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:11.880669 15195 heartbeater.cc:511] Master 127.26.23.190:33345 requested a full tablet report, sending...
I20260808 07:04:11.880995 14445 ts_manager.cc:194] Registered new tserver with Master: 024cb4c3ddf541c7add7653ed78e94c4 (127.26.23.131:39963)
I20260808 07:04:11.881513 14445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:50387
I20260808 07:04:11.883651 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:04:11.892141 15234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.884567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48724 (local address 127.26.23.190:33345)
0808 07:04:11.884693 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:11.884694 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:11.884706 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:04:11.884771 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:11.884771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:11.884783 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:11.884850 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:11.885512 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.886326 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.887318 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.887613 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.887701 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.889087 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:11.889088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:11.889089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:11.889096 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:11.890928 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:11.891307 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:11.891308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:11.891308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:11.891379 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:11.891581 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:11.891582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:11.891582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:11.891736 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:11.891839 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:11.891958 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 07:04:11.892045 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260808 07:04:11.894268 14445 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:04:11.896620 14445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:04:11.905409 15248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.899970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.26.23.130:45413)
0808 07:04:11.900121 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:11.900127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:11.900684 (+ 557us) server_negotiation.cc:407] Connection header received
0808 07:04:11.900831 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:11.900833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:11.900850 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:11.900898 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:11.901397 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.902486 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.903999 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.904707 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.904751 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.904803 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:11.905292 (+ 489us) server_negotiation.cc:299] Negotiation successful
0808 07:04:11.905333 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260808 07:04:11.905622 15252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.899697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:45413 (local address 127.0.0.1:47106)
0808 07:04:11.900473 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:11.900520 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:11.900729 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:11.901264 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:11.901265 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:11.901268 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:11.901313 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:11.901314 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.902583 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.902584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:11.903905 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:11.903908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.905101 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.905102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:11.905180 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.905193 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:04:11.905479 (+ 286us) client_negotiation.cc:240] Negotiation successful
0808 07:04:11.905551 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":18,"thread_start_us":72,"threads_started":1}
I20260808 07:04:11.907234 14858 tablet_service.cc:1467] Processing CreateTablet for tablet aa8407c3c4d34f1bb5871d811807888e (DEFAULT_TABLE table=test-table [id=5c8dc55e546c44a0aceef3ce48a801c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:11.907637 14858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa8407c3c4d34f1bb5871d811807888e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:11.909622 15252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.900325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:39963 (local address 127.0.0.1:50444)
0808 07:04:11.905763 (+ 5438us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:11.905772 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:11.905803 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:11.906034 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:11.906035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:11.906036 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:11.906072 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:11.906074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.907227 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.907228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:11.908493 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:11.908496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.909422 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.909424 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:11.909481 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.909484 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:04:11.909525 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 07:04:11.909560 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5429,"thread_start_us":77,"threads_started":1}
I20260808 07:04:11.909857 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.900518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.26.23.131:39963)
0808 07:04:11.901037 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:11.901041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:11.905852 (+ 4811us) server_negotiation.cc:407] Connection header received
0808 07:04:11.905888 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:11.905891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:11.905906 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:11.905967 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:11.906134 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.907143 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.908585 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.909280 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.909341 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.909391 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:11.909748 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 07:04:11.909786 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":50,"threads_started":1}
I20260808 07:04:11.910512 15083 tablet_service.cc:1467] Processing CreateTablet for tablet aa8407c3c4d34f1bb5871d811807888e (DEFAULT_TABLE table=test-table [id=5c8dc55e546c44a0aceef3ce48a801c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:11.910885 15083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa8407c3c4d34f1bb5871d811807888e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:11.919765 15247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.899722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:46575 (local address 127.0.0.1:48116)
0808 07:04:11.900861 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:11.900870 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:11.900915 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:11.901164 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:11.901167 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:11.901169 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:11.901231 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:11.901233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.902505 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.902506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:11.903808 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:11.903811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.919527 (+ 15716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.919528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:11.919596 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.919600 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:11.919644 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:04:11.919685 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"mutex_wait_us":30,"thread_start_us":85,"threads_started":1}
I20260808 07:04:11.919999 15250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:11.900123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48116 (local address 127.26.23.129:46575)
0808 07:04:11.900268 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:11.900272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:11.901001 (+ 729us) server_negotiation.cc:407] Connection header received
0808 07:04:11.901038 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:11.901041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:11.901068 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:11.901151 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:11.901316 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.902415 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.903914 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:11.919317 (+ 15403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:11.919393 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:11.919454 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:11.919869 (+ 415us) server_negotiation.cc:299] Negotiation successful
0808 07:04:11.919920 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260808 07:04:11.920187 15254 tablet_bootstrap.cc:492] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Bootstrap starting.
I20260808 07:04:11.920821 15254 tablet_bootstrap.cc:654] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:11.921120 15254 log.cc:824] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:11.921892 15254 tablet_bootstrap.cc:492] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: No bootstrap required, opened a new log
I20260808 07:04:11.921952 15254 ts_tablet_manager.cc:1397] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:11.922988 14643 tablet_service.cc:1467] Processing CreateTablet for tablet aa8407c3c4d34f1bb5871d811807888e (DEFAULT_TABLE table=test-table [id=5c8dc55e546c44a0aceef3ce48a801c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:11.923383 14643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa8407c3c4d34f1bb5871d811807888e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:11.924543 15254 raft_consensus.cc:348] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:11.924712 15254 raft_consensus.cc:374] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:11.924742 15254 raft_consensus.cc:729] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 024cb4c3ddf541c7add7653ed78e94c4, State: Initialized, Role: FOLLOWER
I20260808 07:04:11.924899 15255 tablet_bootstrap.cc:492] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Bootstrap starting.
I20260808 07:04:11.924945 15254 consensus_queue.cc:260] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:11.925223 15254 ts_tablet_manager.cc:1428] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:04:11.925655 15255 tablet_bootstrap.cc:654] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:11.925662 15195 heartbeater.cc:503] Master 127.26.23.190:33345 was elected leader, sending a full tablet report...
I20260808 07:04:11.927068 15259 tablet_bootstrap.cc:492] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: Bootstrap starting.
I20260808 07:04:11.927786 15259 tablet_bootstrap.cc:654] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:11.928167 15259 log.cc:824] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:11.928948 15259 tablet_bootstrap.cc:492] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: No bootstrap required, opened a new log
I20260808 07:04:11.929014 15259 ts_tablet_manager.cc:1397] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:11.930251 15255 log.cc:824] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:11.931473 15259 raft_consensus.cc:348] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:11.931631 15259 raft_consensus.cc:374] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:11.931668 15259 raft_consensus.cc:729] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 069c0f35489d41a796801b4184b28381, State: Initialized, Role: FOLLOWER
I20260808 07:04:11.931921 15259 consensus_queue.cc:260] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:11.932253 15259 ts_tablet_manager.cc:1428] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:04:11.932411 14747 heartbeater.cc:503] Master 127.26.23.190:33345 was elected leader, sending a full tablet report...
I20260808 07:04:11.933831 15255 tablet_bootstrap.cc:492] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: No bootstrap required, opened a new log
I20260808 07:04:11.933957 15255 ts_tablet_manager.cc:1397] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260808 07:04:11.936422 15255 raft_consensus.cc:348] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:11.936550 15255 raft_consensus.cc:374] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:11.936582 15255 raft_consensus.cc:729] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27d6cc61b8ec4b95a62370a93b77716d, State: Initialized, Role: FOLLOWER
I20260808 07:04:11.936715 15255 consensus_queue.cc:260] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:11.936968 15255 ts_tablet_manager.cc:1428] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:04:11.937120 14966 heartbeater.cc:503] Master 127.26.23.190:33345 was elected leader, sending a full tablet report...
W20260808 07:04:11.937731 14967 tablet.cc:2369] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 07:04:11 dist-test-slave-zj8q krb5kdc[12931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172651, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for HTTP/127.26.23.148@KRBTEST.COM
W20260808 07:04:11.996497 14748 tablet.cc:2369] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:04:12.117897 15196 tablet.cc:2369] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:12.134765 15257 raft_consensus.cc:482] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:12.134912 15257 raft_consensus.cc:504] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:12.135304 15257 leader_election.cc:288] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27d6cc61b8ec4b95a62370a93b77716d (127.26.23.130:45413), 069c0f35489d41a796801b4184b28381 (127.26.23.129:46575)
I20260808 07:04:12.150081 15250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:12.136140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:36093 (local address 127.26.23.129:46575)
0808 07:04:12.136214 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:12.136216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:12.146323 (+ 10107us) server_negotiation.cc:407] Connection header received
0808 07:04:12.146427 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:12.146428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:12.146438 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:12.146466 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:12.146713 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.147463 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.148930 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.149534 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.149669 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:12.149687 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:12.149953 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 07:04:12.150004 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 07:04:12.150602 15271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:12.135773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:46575 (local address 127.26.23.131:36093)
0808 07:04:12.146240 (+ 10467us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:12.146254 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:12.146355 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:12.146553 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:12.146554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:12.146556 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:12.146630 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:12.146632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.147564 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.147565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:12.148823 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:12.148826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.149783 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.149784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:12.149865 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:12.149869 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:12.150450 (+ 581us) client_negotiation.cc:240] Negotiation successful
0808 07:04:12.150498 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10445,"thread_start_us":52,"threads_started":1}
I20260808 07:04:12.151136 14673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8407c3c4d34f1bb5871d811807888e" candidate_uuid: "024cb4c3ddf541c7add7653ed78e94c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c0f35489d41a796801b4184b28381" is_pre_election: true
I20260808 07:04:12.151326 14673 raft_consensus.cc:2454] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024cb4c3ddf541c7add7653ed78e94c4 in term 0.
I20260808 07:04:12.151705 15002 leader_election.cc:302] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024cb4c3ddf541c7add7653ed78e94c4, 069c0f35489d41a796801b4184b28381; no voters:
I20260808 07:04:12.151858 15257 raft_consensus.cc:2781] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:04:12.151909 15257 raft_consensus.cc:482] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:04:12.151932 15257 raft_consensus.cc:3037] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:12.152866 15257 raft_consensus.cc:504] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:12.153008 15257 leader_election.cc:288] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [CANDIDATE]: Term 1 election: Requested vote from peers 27d6cc61b8ec4b95a62370a93b77716d (127.26.23.130:45413), 069c0f35489d41a796801b4184b28381 (127.26.23.129:46575)
I20260808 07:04:12.153309 14673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8407c3c4d34f1bb5871d811807888e" candidate_uuid: "024cb4c3ddf541c7add7653ed78e94c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "069c0f35489d41a796801b4184b28381"
I20260808 07:04:12.153403 14673 raft_consensus.cc:3037] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:12.154386 14673 raft_consensus.cc:2454] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024cb4c3ddf541c7add7653ed78e94c4 in term 1.
I20260808 07:04:12.154560 15002 leader_election.cc:302] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 024cb4c3ddf541c7add7653ed78e94c4, 069c0f35489d41a796801b4184b28381; no voters:
I20260808 07:04:12.154702 15257 raft_consensus.cc:2781] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:12.154874 15257 raft_consensus.cc:686] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 1 LEADER]: Becoming Leader. State: Replica: 024cb4c3ddf541c7add7653ed78e94c4, State: Running, Role: LEADER
I20260808 07:04:12.154974 15257 consensus_queue.cc:237] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } }
I20260808 07:04:12.155218 15248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:12.136068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:49711 (local address 127.26.23.130:45413)
0808 07:04:12.136183 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:12.136185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:12.139820 (+ 3635us) server_negotiation.cc:407] Connection header received
0808 07:04:12.139939 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:12.139940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:12.139950 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:12.139980 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:12.140223 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.140958 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.154249 (+ 13291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.154807 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.154860 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:12.154870 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:12.155108 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 07:04:12.155155 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 07:04:12.155442 15273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:12.135564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:45413 (local address 127.26.23.131:49711)
0808 07:04:12.139733 (+ 4169us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:12.139747 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:12.139856 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:12.140054 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:12.140056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:12.140058 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:12.140144 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:12.140146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.141069 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.141070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:12.142418 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:12.142422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.154931 (+ 12509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.154932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:12.155006 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:12.155010 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:12.155323 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 07:04:12.155373 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4144,"thread_start_us":92,"threads_started":1}
I20260808 07:04:12.155833 14445 catalog_manager.cc:5495] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 024cb4c3ddf541c7add7653ed78e94c4 (127.26.23.131). New cstate: current_term: 1 leader_uuid: "024cb4c3ddf541c7add7653ed78e94c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "024cb4c3ddf541c7add7653ed78e94c4" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39963 } health_report { overall_health: HEALTHY } } }
I20260808 07:04:12.156814 14886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8407c3c4d34f1bb5871d811807888e" candidate_uuid: "024cb4c3ddf541c7add7653ed78e94c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27d6cc61b8ec4b95a62370a93b77716d" is_pre_election: true
I20260808 07:04:12.156956 14886 raft_consensus.cc:2454] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 024cb4c3ddf541c7add7653ed78e94c4 in term 0.
I20260808 07:04:12.157068 14885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa8407c3c4d34f1bb5871d811807888e" candidate_uuid: "024cb4c3ddf541c7add7653ed78e94c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27d6cc61b8ec4b95a62370a93b77716d"
I20260808 07:04:12.157112 14885 raft_consensus.cc:3037] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:12.157922 14885 raft_consensus.cc:2454] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 024cb4c3ddf541c7add7653ed78e94c4 in term 1.
I20260808 07:04:12.200143 15253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:12.196594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50452 (local address 127.26.23.131:39963)
0808 07:04:12.196638 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:12.196641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:12.196648 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:04:12.196691 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:12.196692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:12.196715 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:12.196780 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:12.197007 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.197777 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.198976 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:12.199298 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:12.199365 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:12.199591 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:12.199730 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:04:12.199805 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:12.200035 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 07:04:12.200060 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:04:12.202564 14673 raft_consensus.cc:1261] T aa8407c3c4d34f1bb5871d811807888e P 069c0f35489d41a796801b4184b28381 [term 1 FOLLOWER]: Refusing update from remote peer 024cb4c3ddf541c7add7653ed78e94c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:12.202989 15275 consensus_queue.cc:1035] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "069c0f35489d41a796801b4184b28381" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:12.205271 14885 raft_consensus.cc:1261] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 1 FOLLOWER]: Refusing update from remote peer 024cb4c3ddf541c7add7653ed78e94c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:12.205637 15275 consensus_queue.cc:1035] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27d6cc61b8ec4b95a62370a93b77716d" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 45413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:12.209019 15282 mvcc.cc:205] Tried to move back new op lower bound from 7316163183418810368 to 7316163183227293696. Current Snapshot: MvccSnapshot[applied={T|T < 7316163183418810368 or (T in {7316163183418810368})}]
I20260808 07:04:12.209640 15298 mvcc.cc:205] Tried to move back new op lower bound from 7316163183418810368 to 7316163183227293696. Current Snapshot: MvccSnapshot[applied={T|T < 7316163183418810368}]
I20260808 07:04:12.210603 15285 mvcc.cc:205] Tried to move back new op lower bound from 7316163183418810368 to 7316163183227293696. Current Snapshot: MvccSnapshot[applied={T|T < 7316163183418810368}]
I20260808 07:04:12.211030 14447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:12.211122 14447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:12.211946 14447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47f4f88d94b846f7956ed6311ca472f0: Sending DeleteTablet for 3 replicas of tablet aa8407c3c4d34f1bb5871d811807888e
I20260808 07:04:12.212392 14858 tablet_service.cc:1514] Processing DeleteTablet for tablet aa8407c3c4d34f1bb5871d811807888e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:12 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:47106
I20260808 07:04:12.212604 14643 tablet_service.cc:1514] Processing DeleteTablet for tablet aa8407c3c4d34f1bb5871d811807888e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:12 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:48116
I20260808 07:04:12.213100 15083 tablet_service.cc:1514] Processing DeleteTablet for tablet aa8407c3c4d34f1bb5871d811807888e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:12 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:50444
I20260808 07:04:12.213738 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 14497
I20260808 07:04:12.228263 15313 tablet_replica.cc:330] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: stopping tablet replica
I20260808 07:04:12.228401 15313 raft_consensus.cc:2229] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:04:12.228521 15313 raft_consensus.cc:2258] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:12.228698 15311 tablet_replica.cc:330] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: stopping tablet replica
I20260808 07:04:12.228817 15311 raft_consensus.cc:2229] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:12.228937 15311 raft_consensus.cc:2258] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:12.229471 15311 ts_tablet_manager.cc:1905] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:12.230228 15313 ts_tablet_manager.cc:1905] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:12.231308 15311 ts_tablet_manager.cc:1918] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:12.231462 15311 log.cc:1196] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/aa8407c3c4d34f1bb5871d811807888e
I20260808 07:04:12.231822 15311 ts_tablet_manager.cc:1939] T aa8407c3c4d34f1bb5871d811807888e P 27d6cc61b8ec4b95a62370a93b77716d: Deleting consensus metadata
I20260808 07:04:12.232197 15313 ts_tablet_manager.cc:1918] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:12.232357 14421 catalog_manager.cc:4841] TS 27d6cc61b8ec4b95a62370a93b77716d (127.26.23.130:45413): tablet aa8407c3c4d34f1bb5871d811807888e (table test-table [id=5c8dc55e546c44a0aceef3ce48a801c3]) successfully deleted
W20260808 07:04:12.235488 14422 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:46575 (error 108)
I20260808 07:04:12.235942 15313 log.cc:1196] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/aa8407c3c4d34f1bb5871d811807888e
I20260808 07:04:12.236304 15313 ts_tablet_manager.cc:1939] T aa8407c3c4d34f1bb5871d811807888e P 024cb4c3ddf541c7add7653ed78e94c4: Deleting consensus metadata
I20260808 07:04:12.236714 14424 catalog_manager.cc:4841] TS 024cb4c3ddf541c7add7653ed78e94c4 (127.26.23.131:39963): tablet aa8407c3c4d34f1bb5871d811807888e (table test-table [id=5c8dc55e546c44a0aceef3ce48a801c3]) successfully deleted
W20260808 07:04:12.236799 15247 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:04:12.235894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:46575 (local address 127.0.0.1:48120)
0808 07:04:12.235946 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:12.235959 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:12.236005 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:12.236737 (+ 732us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:46575: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:04:12.236901 14422 catalog_manager.cc:4584] TS 069c0f35489d41a796801b4184b28381 (127.26.23.129:46575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa8407c3c4d34f1bb5871d811807888e: Network error: Client connection negotiation failed: client connection to 127.26.23.129:46575: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:04:12.237311 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 14751
I20260808 07:04:12.266837 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 14969
I20260808 07:04:12.277511 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 14397
I20260808 07:04:12.291404 26718 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 07:04:12.635048 26718 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 07:04:12.635164 26718 mini_ranger.cc:66] Stopping Ranger...
I20260808 07:04:12.979012 26718 mini_ranger.cc:68] Stopped Ranger
2026-08-08 07:04:12.979 UTC [12972] LOG: received smart shutdown request
2026-08-08 07:04:12.983 UTC [12972] LOG: background worker "logical replication launcher" (PID 12986) exited with exit code 1
2026-08-08 07:04:12.983 UTC [12978] LOG: shutting down
2026-08-08 07:04:13.123 UTC [12972] LOG: database system is shut down
2026-08-08T07:04:13Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47192 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:04:13 dist-test-slave-zj8q krb5kdc[15329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:04:13 dist-test-slave-zj8q krb5kdc[15329](info): set up 2 sockets
Aug 08 07:04:13 dist-test-slave-zj8q krb5kdc[15329](info): commencing operation
krb5kdc: starting...
W20260808 07:04:14.373871 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:04:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:04:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:04:14.488826 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39933
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39933,127.26.23.189:37913,127.26.23.188:46083
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:14.569304 15350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:14.569509 15350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:14.569536 15350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:14.570796 15350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:14.570845 15350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:14.570865 15350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:14.570880 15350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:14.570895 15350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:14.572417 15350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39933,127.26.23.189:37913,127.26.23.188:46083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:14.572666 15350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:14.572865 15350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:14.577497 15359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:14.577507 15356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:14.577728 15350 server_base.cc:1034] running on GCE node
W20260808 07:04:14.577504 15357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:14.578055 15350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:14.578361 15350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:14.579511 15350 hybrid_clock.cc:648] HybridClock initialized: now 1786172654579496 us; error 33 us; skew 500 ppm
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:14.584767 15350 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:14.585229 15350 webserver.cc:460] Webserver started at http://127.26.23.190:37609/ using document root <none> and password file <none>
I20260808 07:04:14.585425 15350 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:14.585469 15350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:14.585599 15350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:14.586686 15350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "0f262989f1254c3ead2d60aa3424c336"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "306bc747fa72e16d4e17f24ae02f76bb"
server_key_iv: "53f0a5add42445ad77f1da0ce971d4f7"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.587013 15350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "0f262989f1254c3ead2d60aa3424c336"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "306bc747fa72e16d4e17f24ae02f76bb"
server_key_iv: "53f0a5add42445ad77f1da0ce971d4f7"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.588292 15350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:04:14.588985 15368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:14.589130 15350 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:14.589219 15350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "0f262989f1254c3ead2d60aa3424c336"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "306bc747fa72e16d4e17f24ae02f76bb"
server_key_iv: "53f0a5add42445ad77f1da0ce971d4f7"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.589280 15350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:14.601647 15350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:14.603504 15350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:14.603637 15350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:14.607654 15350 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39933
I20260808 07:04:14.607690 15452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39933 every 8 connection(s)
I20260808 07:04:14.608012 15350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:14.608880 15453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:14.610509 15453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:04:14.613191 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 15350
I20260808 07:04:14.613309 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:04:14.613484 26718 external_mini_cluster.cc:1428] Setting key 1a41ed6dd058cb47643dd860ca055c91
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:14.620245 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.611303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51260 (local address 127.26.23.190:39933)
0808 07:04:14.611420 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.611424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.611452 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:04:14.611949 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.611950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.611975 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.612045 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.612639 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.613562 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.614743 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.615060 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.615141 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.617276 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.617284 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.617284 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.617290 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.618784 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.619214 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.619216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.619216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.619291 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.619508 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.619509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.619509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.619716 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.619777 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.619984 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.620092 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":83,"thread_start_us":39,"threads_started":1}
I20260808 07:04:14.620311 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.611151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39933 (local address 127.0.0.1:51260)
0808 07:04:14.611308 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.611344 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.611827 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.612082 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.612084 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.612338 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.612490 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.612494 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.613655 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.613657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.614663 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.614666 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.615136 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.615137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.615217 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.615714 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.615722 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.617189 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.618866 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.618873 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.618876 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.619137 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.619344 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.619345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.619345 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.619452 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.619777 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.619784 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.619861 (+ 77us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.619960 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.620171 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":69,"thread_start_us":68,"threads_started":1}
I20260808 07:04:14.620944 15453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:04:14.621268 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.621145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41864)
0808 07:04:14.621194 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.621243 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:04:14.621441 15375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.23.189@KRBTEST.COM; defaulting to no policy
I20260808 07:04:14.621842 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.621749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41868)
0808 07:04:14.621788 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.621818 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:04:14.621955 15453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:37913: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab.
Entry for principal kudu/127.26.23.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab.
I20260808 07:04:14.637172 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:37913
--webserver_interface=127.26.23.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab
--principal=kudu/127.26.23.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39933,127.26.23.189:37913,127.26.23.188:46083
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:14.671202 15453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } attempt: 1
I20260808 07:04:14.671763 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.671552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41874)
0808 07:04:14.671665 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.671719 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:04:14.672158 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.672061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41876)
0808 07:04:14.672100 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.672131 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 07:04:14.672272 15453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:37913: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
W20260808 07:04:14.717232 15466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:14.717427 15466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:14.717447 15466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:14.718551 15466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:14.718588 15466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:14.718601 15466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:14.718613 15466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:14.718636 15466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:14.720088 15466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39933,127.26.23.189:37913,127.26.23.188:46083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab
--principal=kudu/127.26.23.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:37913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.23.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:14.720314 15466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:14.720511 15466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:14.725780 15476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:14.725790 15481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:14.725797 15477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:14.726210 15466 server_base.cc:1034] running on GCE node
I20260808 07:04:14.726461 15466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:14.726696 15466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:14.727825 15466 hybrid_clock.cc:648] HybridClock initialized: now 1786172654727800 us; error 38 us; skew 500 ppm
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:14.733892 15466 init.cc:377] Logged in from keytab as kudu/127.26.23.189@KRBTEST.COM (short username kudu)
I20260808 07:04:14.734395 15466 webserver.cc:460] Webserver started at http://127.26.23.189:44449/ using document root <none> and password file <none>
I20260808 07:04:14.734642 15466 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:14.734705 15466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:14.734844 15466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:14.736142 15466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data/instance:
uuid: "5390c37347f84890acce38a8ab3756a1"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "cf6a525c47ea87c3e97280a843566ce4"
server_key_iv: "4fd6654f9b279bee8669ffb1b1469292"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.736485 15466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal/instance:
uuid: "5390c37347f84890acce38a8ab3756a1"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "cf6a525c47ea87c3e97280a843566ce4"
server_key_iv: "4fd6654f9b279bee8669ffb1b1469292"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.737841 15466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:04:14.738703 15490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:14.738866 15466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:14.738966 15466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal
uuid: "5390c37347f84890acce38a8ab3756a1"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "cf6a525c47ea87c3e97280a843566ce4"
server_key_iv: "4fd6654f9b279bee8669ffb1b1469292"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.739041 15466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:14.740417 15453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } attempt: 2
I20260808 07:04:14.742043 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.741913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41884)
0808 07:04:14.741973 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.742011 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:04:14.742381 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.742292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41890)
0808 07:04:14.742330 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.742355 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:04:14.742493 15453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:37913: Network error: Client connection negotiation failed: client connection to 127.26.23.189:37913: connect: Connection refused (error 111)
I20260808 07:04:14.759148 15466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:14.761673 15466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:14.761813 15466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:14.766381 15466 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.189:37913
I20260808 07:04:14.766428 15573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.189:37913 every 8 connection(s)
I20260808 07:04:14.766768 15466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
I20260808 07:04:14.767781 15575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:14.769989 15575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:04:14.773818 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 15466
I20260808 07:04:14.773918 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-1/wal/instance
I20260808 07:04:14.774129 26718 external_mini_cluster.cc:1428] Setting key e54078766dc0ade9c358aa82697c46ce
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:14.779933 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.770853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51266 (local address 127.26.23.190:39933)
0808 07:04:14.770913 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.770915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.771117 (+ 202us) server_negotiation.cc:407] Connection header received
0808 07:04:14.771557 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.771558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.771574 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.771660 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.772265 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.773009 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.774413 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.774618 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.774675 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.777146 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.777147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.777148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.777154 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.778521 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.778946 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.778947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.778947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.779009 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.779229 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.779231 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.779231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.779348 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.779404 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.779740 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.779834 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:04:14.780083 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.770814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39933 (local address 127.0.0.1:51266)
0808 07:04:14.770982 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.771024 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.771469 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.771716 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.771719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.771961 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.772181 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.772185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.773129 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.773130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.774334 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.774337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.774698 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.774699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.774839 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.775294 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.775304 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.777037 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.778594 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.778601 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.778603 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.778883 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.779063 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.779064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.779064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.779173 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.779403 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.779409 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.779566 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.779690 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.779861 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260808 07:04:14.781010 15575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.23.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.188@KRBTEST.COM" created.
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:04:14.789677 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.781267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41902)
0808 07:04:14.781426 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.781436 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.781474 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.781636 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.781638 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.781783 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.781842 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.781844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.782789 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.782790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.783540 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.783544 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.783993 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.783994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.784055 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.784383 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.784388 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.786871 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.788651 (+ 1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.788652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.788652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.788827 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.789016 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.789016 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.789017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.789067 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.789346 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.789347 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.789385 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.789441 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.789582 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260808 07:04:14.789790 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.781304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41902 (local address 127.26.23.189:37913)
0808 07:04:14.781443 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.781453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.781471 (+ 18us) server_negotiation.cc:407] Connection header received
0808 07:04:14.781531 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.781533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.781544 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.781603 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.781906 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.782703 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.783634 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.783930 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.783985 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.786954 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.786960 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.786961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.786966 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.788558 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.788903 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.788907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.788907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.788965 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.789140 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.789141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.789142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.789284 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.789357 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.789478 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.789673 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":102,"server-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260808 07:04:14.790596 15575 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:04:14.790927 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.790815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35438)
0808 07:04:14.790858 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.790903 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:04:14.791059 15494 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
I20260808 07:04:14.791430 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.791346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35448)
0808 07:04:14.791382 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.791405 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 07:04:14.791531 15575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:46083: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab.
Entry for principal kudu/127.26.23.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab.
I20260808 07:04:14.801275 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:46083
--webserver_interface=127.26.23.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab
--principal=kudu/127.26.23.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:46301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39933,127.26.23.189:37913,127.26.23.188:46083
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:14.833650 15453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } attempt: 3
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:04:14.840492 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.834076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41904 (local address 127.26.23.189:37913)
0808 07:04:14.834142 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.834145 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.834179 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:04:14.834225 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.834226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.834240 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.834287 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.834603 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.835103 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.835791 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.836011 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.836071 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.838208 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.838210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.838210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.838218 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.839451 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.839837 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.839838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.839839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.839896 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.840071 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.840072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.840072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.840174 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.840220 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.840362 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.840425 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:04:14.840541 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.833997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41904)
0808 07:04:14.834071 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.834082 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.834134 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.834299 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.834300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.834459 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.834527 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.834529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.835193 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.835194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.835713 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.835716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.836074 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.836076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.836150 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.836612 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.836616 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.838091 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.839529 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.839530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.839530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.839762 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.839955 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.839956 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.839956 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.840020 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.840225 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.840226 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.840279 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.840345 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.840444 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 07:04:14.840744 15575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } attempt: 1
I20260808 07:04:14.841079 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.840968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35456)
0808 07:04:14.841018 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.841054 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 07:04:14.841128 15453 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:04:14.841439 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.841338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35460)
0808 07:04:14.841382 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.841415 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:04:14.841584 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.841510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35468)
0808 07:04:14.841541 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.841565 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 07:04:14.841665 15575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:46083: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
I20260808 07:04:14.841764 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.841683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35484)
0808 07:04:14.841712 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.841739 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 07:04:14.841871 15453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:46083: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
I20260808 07:04:14.873025 15453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } attempt: 1
I20260808 07:04:14.873472 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.873332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35496)
0808 07:04:14.873394 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.873437 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 07:04:14.873821 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.873720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35508)
0808 07:04:14.873763 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.873795 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:04:14.873926 15453 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:46083: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
W20260808 07:04:14.884464 15586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:14.884646 15586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:14.884666 15586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:14.885771 15586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:14.885818 15586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:14.885836 15586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:14.885852 15586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:14.885869 15586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:14.887389 15586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:46301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39933,127.26.23.189:37913,127.26.23.188:46083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab
--principal=kudu/127.26.23.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:46083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.23.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:14.887570 15586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:14.887732 15586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:14.892293 15598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:14.892323 15602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:14.892511 15586 server_base.cc:1034] running on GCE node
W20260808 07:04:14.892342 15596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:14.892825 15586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:14.893082 15586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:14.894208 15586 hybrid_clock.cc:648] HybridClock initialized: now 1786172654894197 us; error 27 us; skew 500 ppm
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:14.896585 15586 init.cc:377] Logged in from keytab as kudu/127.26.23.188@KRBTEST.COM (short username kudu)
I20260808 07:04:14.897004 15586 webserver.cc:460] Webserver started at http://127.26.23.188:44807/ using document root <none> and password file <none>
I20260808 07:04:14.897177 15586 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:14.897217 15586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:14.897308 15586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:14.898341 15586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data/instance:
uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "86ec742bec4d5051726efd39667537d7"
server_key_iv: "ce6f8fc4e2b5534208300d176fe97cb0"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.898638 15586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal/instance:
uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "86ec742bec4d5051726efd39667537d7"
server_key_iv: "ce6f8fc4e2b5534208300d176fe97cb0"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.899838 15586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:14.900501 15611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:14.900707 15586 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:14.900791 15586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal
uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c"
format_stamp: "Formatted at 2026-08-08 07:04:14 on dist-test-slave-zj8q"
server_key: "86ec742bec4d5051726efd39667537d7"
server_key_iv: "ce6f8fc4e2b5534208300d176fe97cb0"
server_key_version: "encryptionkey@0"
I20260808 07:04:14.900851 15586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:14.909782 15575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } attempt: 2
I20260808 07:04:14.910183 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.910045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35524)
0808 07:04:14.910100 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.910135 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:04:14.910463 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.910395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35534)
0808 07:04:14.910426 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.910447 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:04:14.910554 15575 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:46083: Network error: Client connection negotiation failed: client connection to 127.26.23.188:46083: connect: Connection refused (error 111)
I20260808 07:04:14.918051 15586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:14.920044 15586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:14.920182 15586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:14.924052 15586 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.188:46083
I20260808 07:04:14.924172 15708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.188:46083 every 8 connection(s)
I20260808 07:04:14.924410 15586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
I20260808 07:04:14.925230 15709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:14.926462 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 15586
I20260808 07:04:14.926554 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786172503363962-26718-0/minicluster-data/master-2/wal/instance
I20260808 07:04:14.926734 26718 external_mini_cluster.cc:1428] Setting key acc65e01c6677a7b5844d7134c5f1dfd
I20260808 07:04:14.926895 15709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
I20260808 07:04:14.935314 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.927514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51274 (local address 127.26.23.190:39933)
0808 07:04:14.927554 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.927556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.927782 (+ 226us) server_negotiation.cc:407] Connection header received
0808 07:04:14.928029 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.928030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.928039 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.928093 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.928634 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.929099 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.930121 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.930413 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.930462 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.932702 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.932704 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.932704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.932712 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.933947 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.934405 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.934406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.934406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.934454 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.934685 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.934686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.934686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.934804 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.934871 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.935139 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.935221 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:04:14.935437 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.927462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39933 (local address 127.0.0.1:51274)
0808 07:04:14.927675 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.927709 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.927945 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.928114 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.928116 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.928376 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.928546 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.928550 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.929177 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.929178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.930041 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.930044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.930475 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.930476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.930654 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.931082 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.931090 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.932599 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.934017 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.934025 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.934027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.934334 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.934507 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.934507 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.934508 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.934626 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.934866 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.934870 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.934977 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.935085 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.935227 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
I20260808 07:04:14.935792 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.927202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35538 (local address 127.26.23.188:46083)
0808 07:04:14.927380 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.927389 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.927421 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:04:14.927936 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.927946 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.927970 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.928067 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.928640 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.929569 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.930316 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.930693 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.930763 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.933022 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.933030 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.933031 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.933038 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.934694 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.935020 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.935022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.935023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.935079 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.935268 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.935268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.935269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.935428 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.935578 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.935631 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.935705 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":78,"threads_started":1}
I20260808 07:04:14.936012 15709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:14.942406 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.936302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41916 (local address 127.26.23.189:37913)
0808 07:04:14.936347 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.936349 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.936356 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:04:14.936378 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.936379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.936387 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.936433 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.936709 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.937363 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.938209 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.938503 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.938567 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.940197 (+ 1630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.940198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.940199 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.940207 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.941414 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.941701 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.941702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.941702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.941752 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.941909 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.941910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.941910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.942009 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.942062 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.942248 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.942317 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:04:14.942406 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.936225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:37913 (local address 127.0.0.1:41916)
0808 07:04:14.936264 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.936275 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.936315 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.936447 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.936448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.936581 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.936626 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.936628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.937434 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.937435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.938125 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.938128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.938566 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.938567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.938621 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.938929 (+ 308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.938934 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.940105 (+ 1171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.941485 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.941486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.941486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.941643 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.941804 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.941805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.941805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.941859 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.942063 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.942064 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.942112 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.942220 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.942311 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260808 07:04:14.942905 15709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:04:14.943645 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.936577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51282 (local address 127.26.23.190:39933)
0808 07:04:14.936616 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.936618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.936625 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:04:14.936642 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.936643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.936651 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.936696 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.937239 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.937901 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.938759 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.938987 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.939049 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.941060 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.941062 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.941062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.941069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.942308 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.942717 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.942718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.942719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.942781 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.942964 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.942965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.942965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.943267 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.943437 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.943476 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.943545 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:04:14.948681 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.943121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35544)
0808 07:04:14.943167 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.943176 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.943204 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.943307 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.943307 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.943440 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.943470 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.943471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.944265 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.944266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.944711 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.944712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.945016 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.945017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.945061 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.945376 (+ 315us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.945381 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.946448 (+ 1067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.947769 (+ 1321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.947770 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.947770 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.947934 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.948125 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.948126 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.948126 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.948189 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.948403 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.948404 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.948441 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.948502 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.948592 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:04:14.948850 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.943159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35544 (local address 127.26.23.188:46083)
0808 07:04:14.943190 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.943192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.943200 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:04:14.943238 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.943239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.943247 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.943302 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.943527 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.944119 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.944778 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.944964 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.945014 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.946524 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.946526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.946526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.946532 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.947690 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.947999 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.948000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.948001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.948056 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.948249 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.948250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.948250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.948341 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.948395 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.948527 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.948658 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":15}
I20260808 07:04:14.949069 15453 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } attempt: 2
I20260808 07:04:14.950343 15709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c: Bootstrap starting.
I20260808 07:04:14.950850 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.944236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41930 (local address 127.26.23.189:37913)
0808 07:04:14.944285 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.944287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.944293 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:04:14.944310 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.944311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.944319 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.944364 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.944757 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.945175 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.945767 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.945957 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.946005 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.948145 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.948146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.948146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.948153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.949689 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.950051 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.950052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.950052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.950107 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.950342 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.950343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.950344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.950458 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.950660 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.950699 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.950766 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:04:14.951321 15709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:14.951628 15709 log.cc:824] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:14.952600 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:04:14.952708 15709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c: No bootstrap required, opened a new log
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
I20260808 07:04:14.954485 15709 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:14.954723 15709 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:14.954825 15709 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c8376ca82e4a4bb59f7015f3fe6e6c, State: Initialized, Role: FOLLOWER
I20260808 07:04:14.955016 15709 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:14.955315 15709 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:14.956415 15455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.949290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35556)
0808 07:04:14.949332 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:14.949341 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:14.949382 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:14.949494 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:14.949494 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:14.949645 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:14.949682 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.949683 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.950790 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.950791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.951500 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:14.951503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.951941 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.951943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:14.952000 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.952356 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:14.952361 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:14.953655 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:14.955335 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.955336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.955336 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.955545 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.955735 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:14.955736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:14.955736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:14.955802 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:14.956132 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:14.956133 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:14.956179 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:04:14.956239 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:04:14.956326 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:04:14.956694 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.949312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35556 (local address 127.26.23.188:46083)
0808 07:04:14.949340 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.949342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.949370 (+ 28us) server_negotiation.cc:407] Connection header received
0808 07:04:14.949422 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.949423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.949430 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.949477 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.950052 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.950687 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.951597 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.951845 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.951935 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.953753 (+ 1818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.953755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.953755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.953761 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.955241 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.955609 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.955610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.955610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.955670 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.955882 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.955883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.955884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.956039 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.956101 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.956535 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.956616 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 07:04:14.958401 15453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: Bootstrap starting.
I20260808 07:04:14.959110 15453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:14.959401 15453 log.cc:824] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:14.957227 15735 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:14.959998 15735 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:04:14.957546 15756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:04:14.961040 15756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:04:14.960330 15586 master_runner.cc:186] Error getting master registration for 127.26.23.190:39933: OK, instance_id { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" instance_seqno: 1786172654606573 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:04:14.962608 15586 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:04:14.964963 15453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: No bootstrap required, opened a new log
I20260808 07:04:14.964974 15456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.954362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51294 (local address 127.26.23.190:39933)
0808 07:04:14.954398 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.954400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.954756 (+ 356us) server_negotiation.cc:407] Connection header received
0808 07:04:14.954848 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.954849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.954859 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.954885 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.955536 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.956174 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.957040 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.957289 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.957352 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.961064 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.961065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.961066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.961072 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.962759 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.963120 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.963121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.963121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.963177 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.964028 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.964029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.964029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.964160 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.964243 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.964825 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.964898 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:04:14.966449 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.954755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.26.23.189:37913)
0808 07:04:14.954788 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.954789 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.958242 (+ 3453us) server_negotiation.cc:407] Connection header received
0808 07:04:14.958325 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.958326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.958335 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.958360 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.959186 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.959828 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.961206 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.961517 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.961559 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.962991 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.962992 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.962992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.962999 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.964494 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.964872 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.964873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.964873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.964928 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.965372 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.965373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.965373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.965497 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.966009 (+ 512us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.966283 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.966363 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:04:14.966703 15453 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:14.966882 15453 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:14.966946 15453 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f262989f1254c3ead2d60aa3424c336, State: Initialized, Role: FOLLOWER
I20260808 07:04:14.967095 15453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:14.967444 15453 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:14.967444 15764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:14.968372 15764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:04:14.969240 15785 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:04:14.969329 15785 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:04:14.970172 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:14.954552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35568 (local address 127.26.23.188:46083)
0808 07:04:14.955358 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:14.955359 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:14.957154 (+ 1795us) server_negotiation.cc:407] Connection header received
0808 07:04:14.957397 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:14.957398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:14.957407 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:14.957448 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:14.958128 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.958834 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.962676 (+ 3842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:14.962980 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:14.963022 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:14.964357 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:14.964358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:14.964358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:14.964364 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:14.968161 (+ 3797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.968589 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.968590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.968591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.968650 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:14.968936 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:14.968938 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:14.968938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:14.969084 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:14.969175 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:14.969942 (+ 767us) server_negotiation.cc:299] Negotiation successful
0808 07:04:14.970021 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":65,"threads_started":1}
I20260808 07:04:14.970022 15350 master_runner.cc:186] Error getting master registration for 127.26.23.189:37913: OK, instance_id { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" instance_seqno: 1786172654765037 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:04:14.972223 15350 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:04:15.001694 15575 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } attempt: 3
Aug 08 07:04:14 dist-test-slave-zj8q krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172654, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
I20260808 07:04:15.008427 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:15.002089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:46083 (local address 127.0.0.1:35572)
0808 07:04:15.002138 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:15.002168 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:15.002209 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:15.002419 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:15.002421 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:15.002593 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:15.002640 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:15.002642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:15.003355 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:15.003356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:15.003861 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:15.003863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:15.004301 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:15.004302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:15.004346 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:15.004780 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:15.004785 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:15.005953 (+ 1168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:15.007478 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:15.007479 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:15.007479 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:15.007655 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:15.007825 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:15.007825 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:15.007826 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:15.007882 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:15.008109 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:15.008110 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:15.008155 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 07:04:15.008215 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:04:15.008312 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 07:04:15.008442 15730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:15.002266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35572 (local address 127.26.23.188:46083)
0808 07:04:15.002320 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:15.002322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:15.002330 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:04:15.002348 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:15.002349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:15.002357 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:15.002404 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:15.002717 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:15.003277 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:15.003935 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:15.004184 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:15.004245 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:15.006036 (+ 1791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:15.006038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:15.006038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:15.006045 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:15.007402 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:15.007717 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:15.007719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:15.007719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:15.007774 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:15.007935 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:15.007936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:15.007937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:15.008055 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:15.008110 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:15.008257 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:04:15.008336 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:04:15.009753 15575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: Bootstrap starting.
I20260808 07:04:15.010432 15575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:15.010723 15575 log.cc:824] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:15.011500 15575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: No bootstrap required, opened a new log
I20260808 07:04:15.013607 15575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:15.013720 15575 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:15.013753 15575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5390c37347f84890acce38a8ab3756a1, State: Initialized, Role: FOLLOWER
I20260808 07:04:15.013895 15575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:15.014222 15790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.014285 15575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:15.014349 15790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:04:15.016037 15810 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:04:15.016146 15810 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:04:15.018061 15466 master_runner.cc:263] No leader master found from master 5390c37347f84890acce38a8ab3756a1
I20260808 07:04:15.018112 15466 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:04:15.098564 15735 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:15.098707 15735 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:15.098968 15735 leader_election.cc:288] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f262989f1254c3ead2d60aa3424c336 (127.26.23.190:39933), 5390c37347f84890acce38a8ab3756a1 (127.26.23.189:37913)
I20260808 07:04:15.099511 15533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5390c37347f84890acce38a8ab3756a1" is_pre_election: true
I20260808 07:04:15.099685 15533 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1c8376ca82e4a4bb59f7015f3fe6e6c in term 0.
I20260808 07:04:15.100075 15620 leader_election.cc:302] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5390c37347f84890acce38a8ab3756a1, f1c8376ca82e4a4bb59f7015f3fe6e6c; no voters:
I20260808 07:04:15.100370 15735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:04:15.100437 15735 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:04:15.100463 15735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:15.101797 15735 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:15.101922 15735 leader_election.cc:288] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [CANDIDATE]: Term 1 election: Requested vote from peers 0f262989f1254c3ead2d60aa3424c336 (127.26.23.190:39933), 5390c37347f84890acce38a8ab3756a1 (127.26.23.189:37913)
I20260808 07:04:15.102246 15533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5390c37347f84890acce38a8ab3756a1"
I20260808 07:04:15.102329 15533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:15.103157 15533 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c8376ca82e4a4bb59f7015f3fe6e6c in term 1.
I20260808 07:04:15.103389 15620 leader_election.cc:302] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5390c37347f84890acce38a8ab3756a1, f1c8376ca82e4a4bb59f7015f3fe6e6c; no voters:
I20260808 07:04:15.103803 15408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f262989f1254c3ead2d60aa3424c336"
I20260808 07:04:15.103940 15408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:04:15.104385 15377 tablet.cc:2369] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:15.104820 15408 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1c8376ca82e4a4bb59f7015f3fe6e6c in term 1.
I20260808 07:04:15.104931 15409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f262989f1254c3ead2d60aa3424c336" is_pre_election: true
I20260808 07:04:15.104991 15409 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1c8376ca82e4a4bb59f7015f3fe6e6c in term 1. Re-sending same reply.
I20260808 07:04:15.106405 15735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:15.106587 15735 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [term 1 LEADER]: Becoming Leader. State: Replica: f1c8376ca82e4a4bb59f7015f3fe6e6c, State: Running, Role: LEADER
I20260808 07:04:15.106670 15735 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } }
I20260808 07:04:15.107033 15735 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1c8376ca82e4a4bb59f7015f3fe6e6c. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.107100 15735 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:15.107422 15820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:15.107651 15820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:04:15.109817 15533 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [term 1 FOLLOWER]: Refusing update from remote peer f1c8376ca82e4a4bb59f7015f3fe6e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:15.110077 15409 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [term 1 FOLLOWER]: Refusing update from remote peer f1c8376ca82e4a4bb59f7015f3fe6e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:15.110437 15735 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:15.110922 15735 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:15.112213 15790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1c8376ca82e4a4bb59f7015f3fe6e6c. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.112306 15790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:04:15.113181 15764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1c8376ca82e4a4bb59f7015f3fe6e6c. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.113288 15764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:04:15.114640 15735 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.114720 15735 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:15.115211 15790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.115285 15790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:04:15.115569 15824 mvcc.cc:205] Tried to move back new op lower bound from 7316163195327107072 to 7316163195317465088. Current Snapshot: MvccSnapshot[applied={T|T < 7316163195327107072}]
I20260808 07:04:15.115708 15825 mvcc.cc:205] Tried to move back new op lower bound from 7316163195327107072 to 7316163195317465088. Current Snapshot: MvccSnapshot[applied={T|T < 7316163195327107072}]
I20260808 07:04:15.116806 15815 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.116914 15815 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:15.117501 15764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f262989f1254c3ead2d60aa3424c336" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39933 } } peers { permanent_uuid: "5390c37347f84890acce38a8ab3756a1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 37913 } } peers { permanent_uuid: "f1c8376ca82e4a4bb59f7015f3fe6e6c" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 46083 } } }
I20260808 07:04:15.117587 15764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:04:15.117870 15830 mvcc.cc:205] Tried to move back new op lower bound from 7316163195327107072 to 7316163195317465088. Current Snapshot: MvccSnapshot[applied={T|T < 7316163195327107072}]
I20260808 07:04:15.118912 15820 catalog_manager.cc:1347] Generated new cluster ID: dbd7769d65a245c88191787748d6812b
I20260808 07:04:15.118961 15820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:15.142192 15820 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:04:15.143162 15820 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:15.150573 15820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1c8376ca82e4a4bb59f7015f3fe6e6c: Generated new TSK 0
I20260808 07:04:15.150767 15820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:04:15.969831 15785 catalog_manager.cc:1259] Loaded cluster ID: dbd7769d65a245c88191787748d6812b
I20260808 07:04:15.969903 15785 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: loading cluster ID for follower catalog manager: success
I20260808 07:04:15.970758 15785 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: acquiring CA information for follower catalog manager: success
I20260808 07:04:15.971076 15785 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0f262989f1254c3ead2d60aa3424c336: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:04:16.016772 15810 catalog_manager.cc:1259] Loaded cluster ID: dbd7769d65a245c88191787748d6812b
I20260808 07:04:16.016865 15810 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: loading cluster ID for follower catalog manager: success
I20260808 07:04:16.018224 15810 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: acquiring CA information for follower catalog manager: success
I20260808 07:04:16.018637 15810 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5390c37347f84890acce38a8ab3756a1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:04:16.207001 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 15350
I20260808 07:04:16.220971 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 15466
I20260808 07:04:16.229298 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 15586
2026-08-08T07:04:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3014 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:04:16 dist-test-slave-zj8q krb5kdc[15852](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:04:16 dist-test-slave-zj8q krb5kdc[15852](info): set up 2 sockets
Aug 08 07:04:16 dist-test-slave-zj8q krb5kdc[15852](info): commencing operation
krb5kdc: starting...
W20260808 07:04:17.373589 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:04:17 dist-test-slave-zj8q krb5kdc[15852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:04:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:04:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:04:17.484652 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:34295
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:34295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:17.564330 15877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:17.564531 15877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:17.564553 15877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:17.565683 15877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:17.565727 15877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:17.565742 15877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:17.565763 15877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:17.565785 15877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:17.567286 15877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:34295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:34295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:17.567510 15877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:17.567725 15877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:17.572379 15887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:17.572393 15883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:17.572485 15877 server_base.cc:1034] running on GCE node
W20260808 07:04:17.572386 15885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:17.572894 15877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:17.573195 15877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:17.574339 15877 hybrid_clock.cc:648] HybridClock initialized: now 1786172657574319 us; error 33 us; skew 500 ppm
Aug 08 07:04:17 dist-test-slave-zj8q krb5kdc[15852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172657, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:17.576879 15877 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:17.577313 15877 webserver.cc:460] Webserver started at http://127.26.23.190:45529/ using document root <none> and password file <none>
I20260808 07:04:17.577507 15877 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:17.577553 15877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:17.577677 15877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:17.578799 15877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "8101baea9b804d0c9ee2540c5e0bb9ea"
format_stamp: "Formatted at 2026-08-08 07:04:17 on dist-test-slave-zj8q"
server_key: "14b883699ddf736e55e3e7a152f17915"
server_key_iv: "0507aff7306ee72cf5401ba14c890703"
server_key_version: "encryptionkey@0"
I20260808 07:04:17.579135 15877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "8101baea9b804d0c9ee2540c5e0bb9ea"
format_stamp: "Formatted at 2026-08-08 07:04:17 on dist-test-slave-zj8q"
server_key: "14b883699ddf736e55e3e7a152f17915"
server_key_iv: "0507aff7306ee72cf5401ba14c890703"
server_key_version: "encryptionkey@0"
I20260808 07:04:17.580425 15877 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:04:17.581045 15900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:17.581198 15877 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:17.581286 15877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "8101baea9b804d0c9ee2540c5e0bb9ea"
format_stamp: "Formatted at 2026-08-08 07:04:17 on dist-test-slave-zj8q"
server_key: "14b883699ddf736e55e3e7a152f17915"
server_key_iv: "0507aff7306ee72cf5401ba14c890703"
server_key_version: "encryptionkey@0"
I20260808 07:04:17.581354 15877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:17.589525 15877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:17.591243 15877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:17.591374 15877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:17.595193 15877 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:34295
I20260808 07:04:17.595227 16001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:34295 every 8 connection(s)
I20260808 07:04:17.595537 15877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:17.596329 16002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:17.598701 16002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea: Bootstrap starting.
I20260808 07:04:17.598937 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 15877
I20260808 07:04:17.599020 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:04:17.599236 26718 external_mini_cluster.cc:1428] Setting key 3e92a943b7f559447fc9cd8b78db533f
I20260808 07:04:17.599308 16002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:17.599582 16002 log.cc:824] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:17.600412 16002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea: No bootstrap required, opened a new log
I20260808 07:04:17.602680 16002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 34295 } }
I20260808 07:04:17.602837 16002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:17.602864 16002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8101baea9b804d0c9ee2540c5e0bb9ea, State: Initialized, Role: FOLLOWER
I20260808 07:04:17.602988 16002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 34295 } }
I20260808 07:04:17.603060 16002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:17.603084 16002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:17.603130 16002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:17.603708 16002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 34295 } }
I20260808 07:04:17.603813 16002 leader_election.cc:302] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8101baea9b804d0c9ee2540c5e0bb9ea; no voters:
I20260808 07:04:17.603969 16002 leader_election.cc:288] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:04:17.604025 16010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:17.604211 16010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [term 1 LEADER]: Becoming Leader. State: Replica: 8101baea9b804d0c9ee2540c5e0bb9ea, State: Running, Role: LEADER
I20260808 07:04:17.604233 16002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:17.604363 16010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 34295 } }
I20260808 07:04:17.604744 16012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8101baea9b804d0c9ee2540c5e0bb9ea. Latest consensus state: current_term: 1 leader_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 34295 } } }
I20260808 07:04:17.604770 16011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8101baea9b804d0c9ee2540c5e0bb9ea" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 34295 } } }
I20260808 07:04:17.604822 16012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:17.604867 16011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:17.605050 16014 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:17.605723 16014 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:04:17 dist-test-slave-zj8q krb5kdc[15852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:17.607276 16014 catalog_manager.cc:1347] Generated new cluster ID: 440d440ac1804fb5b4d7ae7a0efcc994
I20260808 07:04:17.607329 16014 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:17.610020 16009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:17.599700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47308 (local address 127.26.23.190:34295)
0808 07:04:17.599871 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:17.599879 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:17.599903 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:04:17.600422 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:17.600432 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:17.600491 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:17.600641 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:17.601244 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:17.602646 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:17.603502 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:17.604098 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:17.604271 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:17.607142 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:17.607146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:17.607146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:17.607156 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:17.608682 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:17.609004 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:17.609007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:17.609007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:17.609086 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:17.609270 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:17.609271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:17.609271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:17.609488 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:17.609637 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:17.609737 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:04:17.609864 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260808 07:04:17.614992 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:04:17.630309 16014 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:04:17.630817 16014 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:17.634873 16014 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8101baea9b804d0c9ee2540c5e0bb9ea: Generated new TSK 0
I20260808 07:04:17.635042 16014 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:04:17.668773 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 15877
2026-08-08T07:04:17Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1442 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:04:17 dist-test-slave-zj8q krb5kdc[16046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:04:17 dist-test-slave-zj8q krb5kdc[16046](info): set up 2 sockets
Aug 08 07:04:17 dist-test-slave-zj8q krb5kdc[16046](info): commencing operation
krb5kdc: starting...
W20260808 07:04:18.810854 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:04:18 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:04:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:04:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:04:18.922634 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42337
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:42337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:19.001891 16063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:19.002084 16063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:19.002112 16063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:19.003232 16063 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:19.003273 16063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:19.003290 16063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:19.003307 16063 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:19.003321 16063 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:19.004746 16063 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:42337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:19.004977 16063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:19.005185 16063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:19.009982 16077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.009989 16082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.009989 16076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.010074 16063 server_base.cc:1034] running on GCE node
I20260808 07:04:19.010462 16063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:19.010725 16063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:19.011861 16063 hybrid_clock.cc:648] HybridClock initialized: now 1786172659011841 us; error 32 us; skew 500 ppm
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:19.014303 16063 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:19.014719 16063 webserver.cc:460] Webserver started at http://127.26.23.190:45335/ using document root <none> and password file <none>
I20260808 07:04:19.014881 16063 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:19.014919 16063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:19.015007 16063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:19.015951 16063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "18c9e4d8cb024da7bad1e0c30cc227e1"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "81254bc5450dd3cf44c000d676eec66c"
server_key_iv: "693085d6aa33e4c9e23e750d2b9cf674"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.016242 16063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "18c9e4d8cb024da7bad1e0c30cc227e1"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "81254bc5450dd3cf44c000d676eec66c"
server_key_iv: "693085d6aa33e4c9e23e750d2b9cf674"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.017441 16063 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:04:19.018088 16091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.018267 16063 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:19.018349 16063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "18c9e4d8cb024da7bad1e0c30cc227e1"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "81254bc5450dd3cf44c000d676eec66c"
server_key_iv: "693085d6aa33e4c9e23e750d2b9cf674"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.018411 16063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:19.030074 16063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:19.032126 16063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:19.032272 16063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:19.036314 16063 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:42337
I20260808 07:04:19.036356 16172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:42337 every 8 connection(s)
I20260808 07:04:19.036716 16063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:19.037705 16174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:19.039954 16174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap starting.
I20260808 07:04:19.040467 16174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:19.040715 16174 log.cc:824] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:19.041393 16174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: No bootstrap required, opened a new log
I20260808 07:04:19.043033 16174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.043175 16174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:19.043198 16174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c9e4d8cb024da7bad1e0c30cc227e1, State: Initialized, Role: FOLLOWER
I20260808 07:04:19.043304 16174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.043354 16174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:19.043378 16174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:19.043409 16174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:19.044142 16174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.044229 16174 leader_election.cc:302] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18c9e4d8cb024da7bad1e0c30cc227e1; no voters:
I20260808 07:04:19.044345 16174 leader_election.cc:288] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:04:19.044384 16178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:19.044559 16174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:19.044561 16178 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 LEADER]: Becoming Leader. State: Replica: 18c9e4d8cb024da7bad1e0c30cc227e1, State: Running, Role: LEADER
I20260808 07:04:19.044692 16178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.045047 16179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } } }
I20260808 07:04:19.045059 16180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18c9e4d8cb024da7bad1e0c30cc227e1. Latest consensus state: current_term: 1 leader_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } } }
I20260808 07:04:19.045176 16179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:19.045182 16180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:19.045425 16190 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:19.045930 16190 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:04:19.046813 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 16063
I20260808 07:04:19.046909 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:04:19.047127 26718 external_mini_cluster.cc:1428] Setting key ab0f61ef6f27f9e56eea2afc5cc4ec46
I20260808 07:04:19.047681 16190 catalog_manager.cc:1347] Generated new cluster ID: f14d6741abdb4f89baa138112371bbe4
I20260808 07:04:19.047737 16190 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172658, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:19.057286 16190 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:04:19.057958 16190 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:19.060295 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.047524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54524 (local address 127.26.23.190:42337)
0808 07:04:19.050282 (+ 2758us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.050292 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.050328 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:04:19.050444 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.050451 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.050504 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.050658 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:19.051323 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.052809 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.053784 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.054418 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.054532 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.057303 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:19.057307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:19.057308 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:19.057318 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:19.058878 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.059195 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.059198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.059198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.059286 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.059463 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.059464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.059464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.059680 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:19.059796 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.059924 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.060068 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2707,"thread_start_us":83,"threads_started":1}
I20260808 07:04:19.064227 16190 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Generated new TSK 0
I20260808 07:04:19.064393 16190 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:04:19.090886 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42337
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:19.173064 16210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:19.173257 16210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:19.173280 16210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:19.174431 16210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:19.174474 16210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:19.174499 16210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:19.176000 16210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:19.176218 16210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:19.176429 16210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:19.181325 16219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.181345 16222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.181475 16210 server_base.cc:1034] running on GCE node
W20260808 07:04:19.181336 16220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.181789 16210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:19.182005 16210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:19.183189 16210 hybrid_clock.cc:648] HybridClock initialized: now 1786172659183159 us; error 40 us; skew 500 ppm
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:19.185689 16210 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:19.186116 16210 webserver.cc:460] Webserver started at http://127.26.23.129:45901/ using document root <none> and password file <none>
I20260808 07:04:19.186334 16210 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:19.186384 16210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:19.186509 16210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:19.187494 16210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "0cbc558d1e1340e6954a7a6f782035b2"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "555a62f38658d1b5b27b5445f036e3b2"
server_key_iv: "6c15d061bc0b32b575ef6d13263a024d"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.187827 16210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "0cbc558d1e1340e6954a7a6f782035b2"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "555a62f38658d1b5b27b5445f036e3b2"
server_key_iv: "6c15d061bc0b32b575ef6d13263a024d"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.189093 16210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:04:19.189857 16233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.190007 16210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:19.190097 16210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "0cbc558d1e1340e6954a7a6f782035b2"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "555a62f38658d1b5b27b5445f036e3b2"
server_key_iv: "6c15d061bc0b32b575ef6d13263a024d"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.190191 16210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:19.201381 16210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:19.203409 16210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:19.203552 16210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:19.203748 16210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:19.204021 16210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:19.204063 16210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.204090 16210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:19.204114 16210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.209918 16210 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:41729
I20260808 07:04:19.209978 16407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:41729 every 8 connection(s)
I20260808 07:04:19.210309 16210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:04:19.215606 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 16210
I20260808 07:04:19.215708 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:04:19.215893 26718 external_mini_cluster.cc:1428] Setting key 7f7048d9ac72fb9f98517e6fda1cc998
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:19.219272 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.210951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36619 (local address 127.26.23.190:42337)
0808 07:04:19.211027 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.211030 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.211165 (+ 135us) server_negotiation.cc:407] Connection header received
0808 07:04:19.211672 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.211673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.211684 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.211733 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:19.212705 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.213232 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.214225 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.214423 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.214474 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.216675 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:19.216677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:19.216678 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:19.216686 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:19.217927 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.218387 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.218388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.218388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.218445 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.218666 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.218666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.218667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.218775 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:19.218833 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.219090 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.219182 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:04:19.219434 16413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.210908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:36619)
0808 07:04:19.211056 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.211092 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.211583 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.211794 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.211797 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.212373 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:19.212609 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.212616 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.213335 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.213336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.214139 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.214142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.214482 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.214483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.214580 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.215039 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:19.215049 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:19.216597 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:19.218006 (+ 1409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:19.218014 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:19.218016 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:19.218311 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:19.218499 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:19.218500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:19.218500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:19.218607 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:19.218831 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:19.218838 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:19.218972 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.219060 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.219224 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260808 07:04:19.219906 16409 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42337
I20260808 07:04:19.219988 16409 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:19.220158 16409 heartbeater.cc:511] Master 127.26.23.190:42337 requested a full tablet report, sending...
I20260808 07:04:19.220686 16117 ts_manager.cc:194] Registered new tserver with Master: 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729)
I20260808 07:04:19.221277 16117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:36619
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:04:19.240733 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42337
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:19.322552 16423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:19.322757 16423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:19.322779 16423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:19.323866 16423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:19.323901 16423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:19.323926 16423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:19.325418 16423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:19.325646 16423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:19.325827 16423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:19.330806 16443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.330797 16435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.330797 16439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.330829 16423 server_base.cc:1034] running on GCE node
I20260808 07:04:19.331218 16423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:19.331430 16423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:19.332574 16423 hybrid_clock.cc:648] HybridClock initialized: now 1786172659332554 us; error 32 us; skew 500 ppm
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:19.335131 16423 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:19.335552 16423 webserver.cc:460] Webserver started at http://127.26.23.130:39019/ using document root <none> and password file <none>
I20260808 07:04:19.335779 16423 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:19.335829 16423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:19.335953 16423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:19.336975 16423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "807f6022f34c9726817c784d69b23e58"
server_key_iv: "02ccdd9225747ee5eb2a26b6c08ddcf7"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.337313 16423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "807f6022f34c9726817c784d69b23e58"
server_key_iv: "02ccdd9225747ee5eb2a26b6c08ddcf7"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.338574 16423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:04:19.339244 16457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.339397 16423 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.339483 16423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "807f6022f34c9726817c784d69b23e58"
server_key_iv: "02ccdd9225747ee5eb2a26b6c08ddcf7"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.339540 16423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:19.351738 16423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:19.353374 16423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:19.353502 16423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:19.353701 16423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:19.353974 16423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:19.354008 16423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.354035 16423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:19.354059 16423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.359961 16423 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:36767
I20260808 07:04:19.360015 16639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:36767 every 8 connection(s)
I20260808 07:04:19.360302 16423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:04:19.365659 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 16423
I20260808 07:04:19.365761 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:19.365962 26718 external_mini_cluster.cc:1428] Setting key aa554a08d966bd0cab56526743981472
I20260808 07:04:19.369040 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.360973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:53641 (local address 127.26.23.190:42337)
0808 07:04:19.361038 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.361041 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.361225 (+ 184us) server_negotiation.cc:407] Connection header received
0808 07:04:19.361679 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.361679 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.361688 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.361746 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:19.362647 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.363134 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.364078 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.364268 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.364321 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.366471 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:19.366473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:19.366473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:19.366480 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:19.367674 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.368116 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.368116 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.368117 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.368164 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.368412 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.368413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.368414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.368559 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:19.368644 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.368867 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.368951 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:04:19.369115 16642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.360949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:53641)
0808 07:04:19.361110 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.361151 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.361604 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.361795 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.361798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.362387 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:19.362577 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.362582 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.363203 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.363204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.364003 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.364005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.364330 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.364330 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.364422 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.364814 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:19.364822 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:19.366387 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:19.367746 (+ 1359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:19.367755 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:19.367757 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:19.368039 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:19.368216 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:19.368217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:19.368218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:19.368341 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:19.368637 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:19.368641 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:19.368752 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.368831 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.368946 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260808 07:04:19.369616 16640 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42337
I20260808 07:04:19.369704 16640 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:19.369866 16640 heartbeater.cc:511] Master 127.26.23.190:42337 requested a full tablet report, sending...
I20260808 07:04:19.370220 16117 ts_manager.cc:194] Registered new tserver with Master: c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767)
I20260808 07:04:19.370573 16117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:53641
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:04:19.392266 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42337
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:19.471666 16646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:19.471864 16646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:19.471885 16646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:19.472970 16646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:19.473019 16646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:19.473047 16646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:19.474483 16646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:19.474695 16646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:19.474898 16646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:19.479586 16654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.479573 16653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.479574 16658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.480177 16646 server_base.cc:1034] running on GCE node
I20260808 07:04:19.480382 16646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:19.480597 16646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:19.481738 16646 hybrid_clock.cc:648] HybridClock initialized: now 1786172659481725 us; error 26 us; skew 500 ppm
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:19.484170 16646 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:19.484571 16646 webserver.cc:460] Webserver started at http://127.26.23.131:43455/ using document root <none> and password file <none>
I20260808 07:04:19.484754 16646 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:19.484797 16646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:19.484910 16646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:19.485988 16646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "cf442794d6134c8b89b0a52ebcfce38e"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "ea43a37115f6935da3dd448a097b352b"
server_key_iv: "34d5f1f0dad36589ab652e4c75ed2f91"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.486373 16646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "cf442794d6134c8b89b0a52ebcfce38e"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "ea43a37115f6935da3dd448a097b352b"
server_key_iv: "34d5f1f0dad36589ab652e4c75ed2f91"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.487545 16646 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:04:19.488171 16672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.488318 16646 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:04:19.488397 16646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "cf442794d6134c8b89b0a52ebcfce38e"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "ea43a37115f6935da3dd448a097b352b"
server_key_iv: "34d5f1f0dad36589ab652e4c75ed2f91"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.488458 16646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:19.507021 16646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:19.509172 16646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:19.509303 16646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:19.509532 16646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:19.509856 16646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:19.509891 16646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.509914 16646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:19.509938 16646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.515312 16646 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:40151
I20260808 07:04:19.515369 16840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:40151 every 8 connection(s)
I20260808 07:04:19.515658 16646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:04:19.516868 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 16646
I20260808 07:04:19.516964 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:04:19.517171 26718 external_mini_cluster.cc:1428] Setting key c069895b3fdcb97789f76ea023511f01
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:19.524582 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.516310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:60419 (local address 127.26.23.190:42337)
0808 07:04:19.516375 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.516377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.516564 (+ 187us) server_negotiation.cc:407] Connection header received
0808 07:04:19.517068 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.517070 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.517085 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.517172 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:19.518291 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.518800 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.519730 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.519923 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.519973 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.521898 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:19.521900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:19.521900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:19.521908 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:19.523292 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.523663 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.523664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.523664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.523744 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.523965 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.523966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.523966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.524079 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:19.524137 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.524405 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.524490 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:04:19.524744 16846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.516285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:60419)
0808 07:04:19.516444 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.516486 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.516970 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.517243 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.517248 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.517883 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:19.518207 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.518215 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.518868 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.518869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.519657 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.519659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.519980 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.519980 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.520071 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.520503 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:19.520511 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:19.521816 (+ 1305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:19.523370 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:19.523376 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:19.523378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:19.523595 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:19.523805 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:19.523805 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:19.523806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:19.523910 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:19.524135 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:19.524141 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:19.524284 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.524372 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.524528 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260808 07:04:19.525204 16842 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42337
I20260808 07:04:19.525286 16842 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:19.525460 16842 heartbeater.cc:511] Master 127.26.23.190:42337 requested a full tablet report, sending...
I20260808 07:04:19.525827 16117 ts_manager.cc:194] Registered new tserver with Master: cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
I20260808 07:04:19.526214 16117 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:60419
I20260808 07:04:19.528801 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:04:19.535355 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.530098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54532 (local address 127.26.23.190:42337)
0808 07:04:19.530148 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.530165 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.530256 (+ 91us) server_negotiation.cc:407] Connection header received
0808 07:04:19.530311 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.530312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.530322 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.530365 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:19.530893 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.531352 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.532032 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.532231 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.532282 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.533306 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:19.533308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:19.533308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:19.533315 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:19.534517 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.534797 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.534798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.534798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.534839 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:19.534960 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:19.534960 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:19.534960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:19.535080 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:19.535160 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.535239 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.535296 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:04:19.536635 16117 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:04:19.538197 16117 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:04:19.544437 16856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.540147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:40151 (local address 127.0.0.1:38528)
0808 07:04:19.540757 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.540766 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.540799 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.541100 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.541101 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.541104 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:19.541197 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.541199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.542188 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.542189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.543225 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.543229 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.544066 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.544067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.544193 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.544211 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.544279 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.544330 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":3,"thread_start_us":53,"threads_started":1}
I20260808 07:04:19.544564 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.540347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:36767 (local address 127.0.0.1:38354)
0808 07:04:19.541157 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.541167 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.541214 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.541404 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.541405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.541407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:19.541448 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.541449 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.542663 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.542664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.543610 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.543612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.544379 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.544380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.544435 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.544438 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.544467 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.544500 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"thread_start_us":76,"threads_started":1}
I20260808 07:04:19.544600 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.540323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56950 (local address 127.26.23.129:41729)
0808 07:04:19.540527 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.540532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.540543 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:04:19.540582 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.540584 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.540600 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.540681 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:19.540850 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.541940 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.543414 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.544206 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.544267 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.544320 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.544481 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.544525 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":90,"threads_started":1}
I20260808 07:04:19.544790 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.540195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.26.23.131:40151)
0808 07:04:19.540923 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.540926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.540935 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:04:19.540970 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.540972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.540985 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.541058 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:19.541280 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.542082 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.543299 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.543990 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.544062 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.544120 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.544661 (+ 541us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.544703 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":75,"threads_started":1}
I20260808 07:04:19.544930 16857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.540132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41729 (local address 127.0.0.1:56950)
0808 07:04:19.540272 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.540311 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.540371 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.540716 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.540719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.540721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:19.540771 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.540772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.542068 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.542069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.543325 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.543327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.544277 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.544278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.544345 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.544349 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.544395 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.544435 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":23,"thread_start_us":94,"threads_started":1}
I20260808 07:04:19.545123 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.540450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38354 (local address 127.26.23.130:36767)
0808 07:04:19.540627 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.540630 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.541266 (+ 636us) server_negotiation.cc:407] Connection header received
0808 07:04:19.541309 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.541311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.541325 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.541392 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:19.541511 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.542550 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.543681 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.544312 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.544368 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.544461 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.544812 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.545048 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":93,"threads_started":1}
I20260808 07:04:19.545475 16737 tablet_service.cc:1467] Processing CreateTablet for tablet 8adda420ac7141ca885bb47f433e36a1 (DEFAULT_TABLE table=test-table [id=dfc4cfd334f84f65ba3adbf17392bbb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:19.545890 16737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8adda420ac7141ca885bb47f433e36a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:19.545827 16528 tablet_service.cc:1467] Processing CreateTablet for tablet 8adda420ac7141ca885bb47f433e36a1 (DEFAULT_TABLE table=test-table [id=dfc4cfd334f84f65ba3adbf17392bbb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:19.546079 16528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8adda420ac7141ca885bb47f433e36a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:19.546043 16312 tablet_service.cc:1467] Processing CreateTablet for tablet 8adda420ac7141ca885bb47f433e36a1 (DEFAULT_TABLE table=test-table [id=dfc4cfd334f84f65ba3adbf17392bbb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:19.546371 16312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8adda420ac7141ca885bb47f433e36a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:19.549093 16868 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Bootstrap starting.
I20260808 07:04:19.549352 16873 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap starting.
I20260808 07:04:19.549459 16866 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Bootstrap starting.
I20260808 07:04:19.549746 16868 tablet_bootstrap.cc:654] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:19.549984 16873 tablet_bootstrap.cc:654] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:19.550024 16866 tablet_bootstrap.cc:654] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:19.550276 16868 log.cc:824] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:19.550572 16866 log.cc:824] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:19.550572 16873 log.cc:824] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:19.550999 16868 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: No bootstrap required, opened a new log
I20260808 07:04:19.551072 16868 ts_tablet_manager.cc:1397] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:19.551288 16866 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: No bootstrap required, opened a new log
I20260808 07:04:19.551288 16873 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: No bootstrap required, opened a new log
I20260808 07:04:19.551358 16866 ts_tablet_manager.cc:1397] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:04:19.551358 16873 ts_tablet_manager.cc:1397] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:04:19.552646 16868 raft_consensus.cc:348] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.552775 16868 raft_consensus.cc:374] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:19.552807 16868 raft_consensus.cc:729] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf442794d6134c8b89b0a52ebcfce38e, State: Initialized, Role: FOLLOWER
I20260808 07:04:19.552940 16868 consensus_queue.cc:260] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.553190 16868 ts_tablet_manager.cc:1428] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:19.553308 16842 heartbeater.cc:503] Master 127.26.23.190:42337 was elected leader, sending a full tablet report...
I20260808 07:04:19.553198 16873 raft_consensus.cc:348] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.553198 16866 raft_consensus.cc:348] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.553351 16873 raft_consensus.cc:374] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:19.553351 16866 raft_consensus.cc:374] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:19.553386 16866 raft_consensus.cc:729] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5aefb5d7d4b4027bf3f99107a2c70c8, State: Initialized, Role: FOLLOWER
I20260808 07:04:19.553386 16873 raft_consensus.cc:729] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cbc558d1e1340e6954a7a6f782035b2, State: Initialized, Role: FOLLOWER
I20260808 07:04:19.553501 16873 consensus_queue.cc:260] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.553501 16866 consensus_queue.cc:260] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.553769 16873 ts_tablet_manager.cc:1428] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 07:04:19.553769 16866 ts_tablet_manager.cc:1428] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 07:04:19.553792 16409 heartbeater.cc:503] Master 127.26.23.190:42337 was elected leader, sending a full tablet report...
I20260808 07:04:19.553941 16640 heartbeater.cc:503] Master 127.26.23.190:42337 was elected leader, sending a full tablet report...
W20260808 07:04:19.610836 16641 tablet.cc:2369] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:19.701093 16880 raft_consensus.cc:482] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:19.701246 16880 raft_consensus.cc:504] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.701671 16880 leader_election.cc:288] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
I20260808 07:04:19.705606 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.701954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:59707 (local address 127.26.23.129:41729)
0808 07:04:19.702002 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.702004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.702014 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:04:19.702055 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.702056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.702070 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.702134 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:19.702349 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.703124 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.704659 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.705242 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.705311 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.705321 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.705480 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.705527 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:04:19.705606 16858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.701949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:60403 (local address 127.26.23.131:40151)
0808 07:04:19.702001 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.702003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.702172 (+ 169us) server_negotiation.cc:407] Connection header received
0808 07:04:19.702209 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.702210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.702220 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.702268 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:19.702407 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.703123 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.704660 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.705238 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.705312 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.705321 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.705479 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.705527 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:04:19.705631 16642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.701846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41729 (local address 127.26.23.130:59707)
0808 07:04:19.701898 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.701910 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.701975 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.702187 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.702188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.702190 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:19.702267 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.702269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.703214 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.703215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.704560 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.704564 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.705323 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.705324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.705415 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.705417 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.705465 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.705532 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":77}
I20260808 07:04:19.705643 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.701847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:40151 (local address 127.26.23.130:60403)
0808 07:04:19.702081 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.702089 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:19.702136 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:19.702277 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:19.702278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:19.702279 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:19.702339 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.702340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.703213 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.703215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.704560 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:19.704564 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.705323 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.705324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:19.705409 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.705414 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:04:19.705465 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 07:04:19.705532 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":120,"thread_start_us":132,"threads_started":1}
I20260808 07:04:19.706053 16768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adda420ac7141ca885bb47f433e36a1" candidate_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf442794d6134c8b89b0a52ebcfce38e" is_pre_election: true
I20260808 07:04:19.706064 16350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adda420ac7141ca885bb47f433e36a1" candidate_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cbc558d1e1340e6954a7a6f782035b2" is_pre_election: true
I20260808 07:04:19.706235 16768 raft_consensus.cc:2454] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5aefb5d7d4b4027bf3f99107a2c70c8 in term 0.
I20260808 07:04:19.706270 16350 raft_consensus.cc:2454] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5aefb5d7d4b4027bf3f99107a2c70c8 in term 0.
I20260808 07:04:19.706480 16458 leader_election.cc:302] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e; no voters:
I20260808 07:04:19.706610 16880 raft_consensus.cc:2781] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:04:19.706674 16880 raft_consensus.cc:482] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:04:19.706691 16880 raft_consensus.cc:3037] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:19.707406 16880 raft_consensus.cc:504] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.707533 16880 leader_election.cc:288] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [CANDIDATE]: Term 1 election: Requested vote from peers 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
I20260808 07:04:19.707707 16350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adda420ac7141ca885bb47f433e36a1" candidate_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cbc558d1e1340e6954a7a6f782035b2"
I20260808 07:04:19.707755 16768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adda420ac7141ca885bb47f433e36a1" candidate_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf442794d6134c8b89b0a52ebcfce38e"
I20260808 07:04:19.707815 16350 raft_consensus.cc:3037] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:19.707823 16768 raft_consensus.cc:3037] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:19.708704 16768 raft_consensus.cc:2454] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5aefb5d7d4b4027bf3f99107a2c70c8 in term 1.
I20260808 07:04:19.708704 16350 raft_consensus.cc:2454] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5aefb5d7d4b4027bf3f99107a2c70c8 in term 1.
I20260808 07:04:19.708880 16461 leader_election.cc:302] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cbc558d1e1340e6954a7a6f782035b2, c5aefb5d7d4b4027bf3f99107a2c70c8; no voters:
I20260808 07:04:19.708974 16880 raft_consensus.cc:2781] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:19.709136 16880 raft_consensus.cc:686] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 LEADER]: Becoming Leader. State: Replica: c5aefb5d7d4b4027bf3f99107a2c70c8, State: Running, Role: LEADER
I20260808 07:04:19.709225 16880 consensus_queue.cc:237] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:19.710002 16117 catalog_manager.cc:5495] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } health_report { overall_health: HEALTHY } } }
W20260808 07:04:19.710955 16412 tablet.cc:2369] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:19.723356 16863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.721186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38356 (local address 127.26.23.130:36767)
0808 07:04:19.721228 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:19.721229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:19.721237 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:04:19.721307 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:19.721307 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:19.721322 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:19.721378 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:19.721482 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.721938 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.722732 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:19.722921 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:19.722972 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:19.723080 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:19.723183 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:04:19.723240 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:19.723253 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 07:04:19.723270 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:04:19.725061 16768 raft_consensus.cc:1261] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Refusing update from remote peer c5aefb5d7d4b4027bf3f99107a2c70c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:19.725076 16350 raft_consensus.cc:1261] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Refusing update from remote peer c5aefb5d7d4b4027bf3f99107a2c70c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:19.725409 16884 consensus_queue.cc:1035] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:19.725553 16880 consensus_queue.cc:1035] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:19.727708 16890 mvcc.cc:205] Tried to move back new op lower bound from 7316163214231261184 to 7316163214169505792. Current Snapshot: MvccSnapshot[applied={T|T < 7316163214231261184}]
I20260808 07:04:19.728308 16892 mvcc.cc:205] Tried to move back new op lower bound from 7316163214231261184 to 7316163214169505792. Current Snapshot: MvccSnapshot[applied={T|T < 7316163214231261184}]
I20260808 07:04:19.730142 16115 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:19.730299 16115 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:19.731036 16115 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Sending DeleteTablet for 3 replicas of tablet 8adda420ac7141ca885bb47f433e36a1
I20260808 07:04:19.731395 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 16210
I20260808 07:04:19.731362 16737 tablet_service.cc:1514] Processing DeleteTablet for tablet 8adda420ac7141ca885bb47f433e36a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:19 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38528
I20260808 07:04:19.731432 16528 tablet_service.cc:1514] Processing DeleteTablet for tablet 8adda420ac7141ca885bb47f433e36a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:19 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38354
I20260808 07:04:19.741197 16901 tablet_replica.cc:330] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: stopping tablet replica
I20260808 07:04:19.741346 16901 raft_consensus.cc:2229] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:19.741469 16901 raft_consensus.cc:2258] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:19.741556 16902 tablet_replica.cc:330] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: stopping tablet replica
I20260808 07:04:19.741838 16902 raft_consensus.cc:2229] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:04:19.742027 16902 raft_consensus.cc:2258] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:19.742050 16901 ts_tablet_manager.cc:1905] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:19.742578 16902 ts_tablet_manager.cc:1905] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:19.743893 16901 ts_tablet_manager.cc:1918] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:19.743975 16901 log.cc:1196] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/8adda420ac7141ca885bb47f433e36a1
I20260808 07:04:19.744272 16901 ts_tablet_manager.cc:1939] T 8adda420ac7141ca885bb47f433e36a1 P cf442794d6134c8b89b0a52ebcfce38e: Deleting consensus metadata
I20260808 07:04:19.744585 16902 ts_tablet_manager.cc:1918] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:19.744722 16902 log.cc:1196] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/8adda420ac7141ca885bb47f433e36a1
I20260808 07:04:19.744786 16092 catalog_manager.cc:4841] TS cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): tablet 8adda420ac7141ca885bb47f433e36a1 (table test-table [id=dfc4cfd334f84f65ba3adbf17392bbb3]) successfully deleted
I20260808 07:04:19.745151 16902 ts_tablet_manager.cc:1939] T 8adda420ac7141ca885bb47f433e36a1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Deleting consensus metadata
I20260808 07:04:19.745582 16094 catalog_manager.cc:4841] TS c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): tablet 8adda420ac7141ca885bb47f433e36a1 (table test-table [id=dfc4cfd334f84f65ba3adbf17392bbb3]) successfully deleted
W20260808 07:04:19.746742 16094 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:41729 (error 108)
I20260808 07:04:19.747036 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 16423
I20260808 07:04:19.748885 16857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:19.747171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41729 (local address 127.0.0.1:56954)
0808 07:04:19.748785 (+ 1614us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:19.748847 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:41729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1588}
W20260808 07:04:19.749054 16094 catalog_manager.cc:4584] TS 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8adda420ac7141ca885bb47f433e36a1: Network error: Client connection negotiation failed: client connection to 127.26.23.129:41729: connect: Connection refused (error 111)
I20260808 07:04:19.756930 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 16646
I20260808 07:04:19.767932 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 16063
I20260808 07:04:19.779587 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42337
--webserver_interface=127.26.23.190
--webserver_port=45335
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:42337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:19.860982 16906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:19.861182 16906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:19.861220 16906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:19.862372 16906 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:19.862411 16906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:19.862430 16906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:19.862447 16906 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:19.862462 16906 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:19.863898 16906 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:42337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=45335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:19.864130 16906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:19.864332 16906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:19.873054 16924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:19.873056 16919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.873222 16906 server_base.cc:1034] running on GCE node
W20260808 07:04:19.873116 16918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:19.873566 16906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:19.873878 16906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:19.875023 16906 hybrid_clock.cc:648] HybridClock initialized: now 1786172659875006 us; error 27 us; skew 500 ppm
Aug 08 07:04:19 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172659, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:19.880851 16906 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:19.881325 16906 webserver.cc:460] Webserver started at http://127.26.23.190:45335/ using document root <none> and password file <none>
I20260808 07:04:19.881549 16906 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:19.881611 16906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:19.882966 16906 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:19.883625 16932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:19.883805 16906 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:19.883885 16906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "18c9e4d8cb024da7bad1e0c30cc227e1"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "81254bc5450dd3cf44c000d676eec66c"
server_key_iv: "693085d6aa33e4c9e23e750d2b9cf674"
server_key_version: "encryptionkey@0"
I20260808 07:04:19.884264 16906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:19.903401 16906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:19.905092 16906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:19.905220 16906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:19.909080 16906 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:42337
I20260808 07:04:19.909127 17013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:42337 every 8 connection(s)
I20260808 07:04:19.909475 16906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:19.910985 17014 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:04:19.911578 17014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap starting.
I20260808 07:04:19.914592 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 16906
I20260808 07:04:19.914914 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:41729
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:42337
--webserver_port=45901
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:19.920887 17014 log.cc:824] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:19.922829 17014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:19.923092 17014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap complete.
I20260808 07:04:19.925221 17014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.925438 17014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c9e4d8cb024da7bad1e0c30cc227e1, State: Initialized, Role: FOLLOWER
I20260808 07:04:19.925595 17014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.925668 17014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:19.925717 17014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:19.925763 17014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:04:19.926789 17014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.926883 17014 leader_election.cc:302] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18c9e4d8cb024da7bad1e0c30cc227e1; no voters:
I20260808 07:04:19.927032 17014 leader_election.cc:288] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:04:19.927079 17021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:04:19.927204 17021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 LEADER]: Becoming Leader. State: Replica: 18c9e4d8cb024da7bad1e0c30cc227e1, State: Running, Role: LEADER
I20260808 07:04:19.927294 17014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:19.927299 17021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:19.927698 17022 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18c9e4d8cb024da7bad1e0c30cc227e1. Latest consensus state: current_term: 2 leader_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } } }
I20260808 07:04:19.927786 17022 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:19.928102 17023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } } }
I20260808 07:04:19.928179 17023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:19.928278 17037 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:19.929157 17037 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:04:19.929258 17037 catalog_manager.cc:1259] Loaded cluster ID: f14d6741abdb4f89baa138112371bbe4
I20260808 07:04:19.929292 17037 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:19.929548 17037 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 07:04:19.932406 17037 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 07:04:19.934093 17037 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:19.934298 17037 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Loaded TSK: 0
I20260808 07:04:19.934499 17037 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:04:20.016911 17016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:20.017154 17016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:20.017186 17016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:20.018724 17016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:20.018782 17016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:20.018819 17016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:20.020469 17016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:41729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=45901
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:20.020646 17016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:20.020862 17016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:20.025943 17063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.026043 17062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.025949 17066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.026396 17016 server_base.cc:1034] running on GCE node
I20260808 07:04:20.026592 17016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:20.026810 17016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:20.027956 17016 hybrid_clock.cc:648] HybridClock initialized: now 1786172660027943 us; error 25 us; skew 500 ppm
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:20.030573 17016 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:20.031001 17016 webserver.cc:460] Webserver started at http://127.26.23.129:45901/ using document root <none> and password file <none>
I20260808 07:04:20.031200 17016 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:20.031273 17016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:20.032622 17016 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:20.033319 17075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.033478 17016 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:20.033563 17016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "0cbc558d1e1340e6954a7a6f782035b2"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "555a62f38658d1b5b27b5445f036e3b2"
server_key_iv: "6c15d061bc0b32b575ef6d13263a024d"
server_key_version: "encryptionkey@0"
I20260808 07:04:20.033890 17016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:20.046475 17016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:20.048517 17016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:20.048645 17016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:20.048902 17016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:20.049342 17086 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:04:20.051245 17016 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:04:20.051290 17016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:04:20.051323 17016 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:04:20.051949 17016 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:04:20.051985 17016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:20.052090 17086 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap starting.
I20260808 07:04:20.058035 17016 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:41729
I20260808 07:04:20.058216 17237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:41729 every 8 connection(s)
I20260808 07:04:20.058473 17016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:04:20.060787 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 17016
I20260808 07:04:20.061074 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:36767
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:42337
--webserver_port=39019
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:20.063707 17086 log.cc:824] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:20.066450 17086 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:20.066757 17086 tablet_bootstrap.cc:492] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap complete.
I20260808 07:04:20.067960 17086 ts_tablet_manager.cc:1397] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.012s
I20260808 07:04:20.069242 17086 raft_consensus.cc:348] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:20.069568 17086 raft_consensus.cc:729] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cbc558d1e1340e6954a7a6f782035b2, State: Initialized, Role: FOLLOWER
I20260808 07:04:20.069701 17086 consensus_queue.cc:260] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } }
I20260808 07:04:20.069964 17086 ts_tablet_manager.cc:1428] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:20.073765 17241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.059097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:59269)
0808 07:04:20.059273 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.059314 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.059783 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.063382 (+ 3599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.063387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.063785 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:20.064084 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.064093 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.065710 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.065711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.067106 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.067110 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.067963 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.067964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.068185 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.068749 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:20.068758 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:20.070501 (+ 1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:20.072259 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:20.072265 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:20.072267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:20.072482 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:20.072720 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:20.072721 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:20.072722 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:20.072825 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:20.073169 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:20.073176 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:20.073303 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.073389 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.073562 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":90,"threads_started":1}
I20260808 07:04:20.073786 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.059208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:59269 (local address 127.26.23.190:42337)
0808 07:04:20.062879 (+ 3671us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.062890 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.062935 (+ 45us) server_negotiation.cc:407] Connection header received
0808 07:04:20.063092 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.063099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.063160 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.064054 (+ 894us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:20.064197 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.065578 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.067203 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.067773 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.067868 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.070629 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:20.070634 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:20.070634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:20.070647 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:20.072178 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.072558 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.072567 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.072568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.072657 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.072882 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.072883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.072883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.073103 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:20.073175 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.073461 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.073618 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3606,"thread_start_us":83,"threads_started":1}
I20260808 07:04:20.074798 17239 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42337
I20260808 07:04:20.074896 17239 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:20.075067 17239 heartbeater.cc:511] Master 127.26.23.190:42337 requested a full tablet report, sending...
I20260808 07:04:20.075750 16958 ts_manager.cc:194] Registered new tserver with Master: 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729)
I20260808 07:04:20.076823 16958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:59269
I20260808 07:04:20.077616 17239 heartbeater.cc:503] Master 127.26.23.190:42337 was elected leader, sending a full tablet report...
I20260808 07:04:20.081004 17247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.076329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41729 (local address 127.0.0.1:56966)
0808 07:04:20.076545 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.076586 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.076647 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.078498 (+ 1851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.078501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.078503 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:20.078575 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.078577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.079341 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.079342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.080122 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.080125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.080726 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.080727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.080808 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.080821 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.080881 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.080935 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":148,"threads_started":1}
I20260808 07:04:20.081001 17248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.076463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56966 (local address 127.26.23.129:41729)
0808 07:04:20.078283 (+ 1820us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.078287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.078297 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:04:20.078328 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.078330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.078352 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.078426 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:20.078646 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.079263 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.080200 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.080651 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.080711 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.080765 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.080902 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.080936 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1792,"thread_start_us":74,"threads_started":1}
I20260808 07:04:20.081537 17139 tablet_service.cc:1514] Processing DeleteTablet for tablet 8adda420ac7141ca885bb47f433e36a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:19 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:56966
I20260808 07:04:20.082000 17250 tablet_replica.cc:330] stopping tablet replica
I20260808 07:04:20.082106 17250 raft_consensus.cc:2229] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:20.082192 17250 raft_consensus.cc:2258] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:20.082475 17250 ts_tablet_manager.cc:1905] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:20.084270 17250 ts_tablet_manager.cc:1918] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:20.084338 17250 log.cc:1196] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/8adda420ac7141ca885bb47f433e36a1
I20260808 07:04:20.084548 17250 ts_tablet_manager.cc:1939] T 8adda420ac7141ca885bb47f433e36a1 P 0cbc558d1e1340e6954a7a6f782035b2: Deleting consensus metadata
I20260808 07:04:20.085033 16935 catalog_manager.cc:4841] TS 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729): tablet 8adda420ac7141ca885bb47f433e36a1 (table test-table [id=dfc4cfd334f84f65ba3adbf17392bbb3]) successfully deleted
W20260808 07:04:20.152858 17243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:20.153052 17243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:20.153074 17243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:20.154178 17243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:20.154227 17243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:20.154258 17243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:20.155673 17243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:36767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=39019
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:20.155892 17243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:20.156102 17243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:20.160971 17258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.160977 17261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.160977 17259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.161156 17243 server_base.cc:1034] running on GCE node
I20260808 07:04:20.161454 17243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:20.161675 17243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:20.162817 17243 hybrid_clock.cc:648] HybridClock initialized: now 1786172660162801 us; error 30 us; skew 500 ppm
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:20.165190 17243 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:20.165627 17243 webserver.cc:460] Webserver started at http://127.26.23.130:39019/ using document root <none> and password file <none>
I20260808 07:04:20.165849 17243 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:20.165912 17243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:20.167274 17243 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:20.167814 17270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.167961 17243 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:20.168048 17243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "807f6022f34c9726817c784d69b23e58"
server_key_iv: "02ccdd9225747ee5eb2a26b6c08ddcf7"
server_key_version: "encryptionkey@0"
I20260808 07:04:20.168388 17243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:20.191032 17243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:20.193174 17243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:20.193311 17243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:20.193521 17243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:20.193821 17243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:20.193854 17243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.193884 17243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:20.193908 17243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.199470 17243 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:36767
I20260808 07:04:20.199543 17456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:36767 every 8 connection(s)
I20260808 07:04:20.199873 17243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:20.207942 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 17243
I20260808 07:04:20.208227 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:40151
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:42337
--webserver_port=43455
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:20.208882 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.200574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:50713 (local address 127.26.23.190:42337)
0808 07:04:20.200659 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.200661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.200822 (+ 161us) server_negotiation.cc:407] Connection header received
0808 07:04:20.201290 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.201292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.201304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.201359 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:20.202327 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.202931 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.203919 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.204132 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.204195 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.206229 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:20.206231 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:20.206231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:20.206240 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:20.207460 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.207842 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.207843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.207843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.207904 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.208204 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.208205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.208205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.208336 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:20.208409 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.208689 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.208785 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 07:04:20.209004 17460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.200543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:50713)
0808 07:04:20.200711 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.200751 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.201208 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.201419 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.201422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.201977 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:20.202211 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.202217 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.203013 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.203014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.203831 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.203834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.204209 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.204209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.204320 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.204752 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:20.204759 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:20.206116 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:20.207537 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:20.207544 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:20.207546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:20.207763 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:20.207966 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:20.207967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:20.207967 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:20.208132 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:20.208424 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:20.208431 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:20.208558 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.208648 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.208799 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260808 07:04:20.209461 17458 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42337
I20260808 07:04:20.209568 17458 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:20.209755 17458 heartbeater.cc:511] Master 127.26.23.190:42337 requested a full tablet report, sending...
I20260808 07:04:20.210212 16958 ts_manager.cc:194] Registered new tserver with Master: c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767)
I20260808 07:04:20.210693 16958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:50713
W20260808 07:04:20.292445 17462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:20.292649 17462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:20.292681 17462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:20.293814 17462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:20.293866 17462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:20.293902 17462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:20.295318 17462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:40151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=43455
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:20.295493 17462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:20.295679 17462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:20.300432 17472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.300458 17468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.300477 17470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.300716 17462 server_base.cc:1034] running on GCE node
I20260808 07:04:20.300894 17462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:20.301096 17462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:20.302214 17462 hybrid_clock.cc:648] HybridClock initialized: now 1786172660302190 us; error 40 us; skew 500 ppm
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:20.304581 17462 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:20.304988 17462 webserver.cc:460] Webserver started at http://127.26.23.131:43455/ using document root <none> and password file <none>
I20260808 07:04:20.305179 17462 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:20.305243 17462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:20.306547 17462 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:04:20.307096 17480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.307241 17462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:04:20.307323 17462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "cf442794d6134c8b89b0a52ebcfce38e"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "ea43a37115f6935da3dd448a097b352b"
server_key_iv: "34d5f1f0dad36589ab652e4c75ed2f91"
server_key_version: "encryptionkey@0"
I20260808 07:04:20.307658 17462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:20.333818 17462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:20.335668 17462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:20.335806 17462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:20.336036 17462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:20.336370 17462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:20.336405 17462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.336436 17462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:20.336452 17462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.341938 17462 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:40151
I20260808 07:04:20.341980 17652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:40151 every 8 connection(s)
I20260808 07:04:20.342324 17462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:04:20.344605 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 17462
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:20.351647 17658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.344952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54548 (local address 127.26.23.190:42337)
0808 07:04:20.345049 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.345051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.345082 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:04:20.345158 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.345159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.345169 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.345222 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:20.345790 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.346540 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.347431 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.347680 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.347749 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.348948 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:20.348949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:20.348949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:20.348957 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:20.350549 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.350890 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.350891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.350891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.350943 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.351157 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.351158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.351158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.351280 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:20.351431 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.351469 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.351549 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":54,"threads_started":1}
I20260808 07:04:20.352038 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.342961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:42549 (local address 127.26.23.190:42337)
0808 07:04:20.343014 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.343017 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.343247 (+ 230us) server_negotiation.cc:407] Connection header received
0808 07:04:20.343702 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.343703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.343714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.343765 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:20.344675 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.345370 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.346732 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.347026 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.347114 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.349404 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:20.349405 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:20.349405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:20.349412 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:20.350695 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.351111 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.351111 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.351112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.351162 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:20.351381 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:20.351382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:20.351382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:20.351497 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:20.351559 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.351889 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.351964 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:04:20.352216 17656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.342967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:42549)
0808 07:04:20.343135 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.343170 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.343627 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.343817 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.343820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.344355 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:20.344546 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.344551 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.345462 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.345463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.346642 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.346645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.347135 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.347135 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.347235 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.347714 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:20.347724 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:20.349328 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:20.350761 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:20.350768 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:20.350770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:20.351035 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:20.351221 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:20.351221 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:20.351222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:20.351318 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:20.351569 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:20.351576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:20.351714 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.351849 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.352003 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260808 07:04:20.352599 17653 heartbeater.cc:347] Connected to a master server at 127.26.23.190:42337
I20260808 07:04:20.352687 17653 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:20.352850 17653 heartbeater.cc:511] Master 127.26.23.190:42337 requested a full tablet report, sending...
I20260808 07:04:20.353150 16958 ts_manager.cc:194] Registered new tserver with Master: cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
I20260808 07:04:20.353469 16958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:42549
I20260808 07:04:20.363233 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:04:20.365983 17242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.363536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.26.23.190:42337)
0808 07:04:20.363572 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.363574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.363687 (+ 113us) server_negotiation.cc:407] Connection header received
0808 07:04:20.363763 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.363764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.363796 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.363850 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:20.363966 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.364426 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.365251 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.365457 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.365512 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.365702 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:20.365793 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:04:20.365858 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.365896 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.365914 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:04:20.366258 16958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54564:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:04:20.367813 16958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:04:20.369747 17139 tablet_service.cc:1467] Processing CreateTablet for tablet 11960da7ce0f4c00a0ec226edf0b5ac1 (DEFAULT_TABLE table=test-table [id=bc2c0579380a405bbdbb8b448509ee40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:20.369963 17139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11960da7ce0f4c00a0ec226edf0b5ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:20.371558 17086 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap starting.
I20260808 07:04:20.371845 17086 tablet_bootstrap.cc:654] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:20.372330 17086 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: No bootstrap required, opened a new log
I20260808 07:04:20.372372 17086 ts_tablet_manager.cc:1397] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:20.372476 17086 raft_consensus.cc:348] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.372541 17086 raft_consensus.cc:374] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:20.372619 17086 raft_consensus.cc:729] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cbc558d1e1340e6954a7a6f782035b2, State: Initialized, Role: FOLLOWER
I20260808 07:04:20.372671 17086 consensus_queue.cc:260] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.372777 17086 ts_tablet_manager.cc:1428] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.374097 17247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.369393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:36767 (local address 127.0.0.1:38370)
0808 07:04:20.369440 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.369451 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.369491 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.370381 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.370382 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.370384 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:20.370415 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.370416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.371456 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.371457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.372955 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.372957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.373836 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.373837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.373907 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.373911 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.373975 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.374023 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":441}
I20260808 07:04:20.374110 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.369670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38540 (local address 127.26.23.131:40151)
0808 07:04:20.369847 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.369851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.369862 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:04:20.369898 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.369900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.369914 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.370002 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:20.370107 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.371292 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.373029 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.373750 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.373826 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.373883 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.373991 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.374028 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260808 07:04:20.374146 17660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.369438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:40151 (local address 127.0.0.1:38540)
0808 07:04:20.369722 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.369733 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.369783 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.370000 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.370000 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.370002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:20.370044 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.370046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.371408 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.371409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.372829 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.372833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.373837 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.373837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.373907 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.373912 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.373975 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.374023 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":158,"thread_start_us":84,"threads_started":1}
I20260808 07:04:20.374115 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.369511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38370 (local address 127.26.23.130:36767)
0808 07:04:20.370255 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.370258 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.370265 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:04:20.370296 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.370297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.370308 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.370373 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:20.370511 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.371354 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.373005 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.373750 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.373826 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.373883 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.373991 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.374029 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":105,"threads_started":1}
I20260808 07:04:20.374879 17557 tablet_service.cc:1467] Processing CreateTablet for tablet 11960da7ce0f4c00a0ec226edf0b5ac1 (DEFAULT_TABLE table=test-table [id=bc2c0579380a405bbdbb8b448509ee40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:20.375080 17343 tablet_service.cc:1467] Processing CreateTablet for tablet 11960da7ce0f4c00a0ec226edf0b5ac1 (DEFAULT_TABLE table=test-table [id=bc2c0579380a405bbdbb8b448509ee40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:20.375185 17557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11960da7ce0f4c00a0ec226edf0b5ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:20.375373 17343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11960da7ce0f4c00a0ec226edf0b5ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:20.377709 17665 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Bootstrap starting.
I20260808 07:04:20.377964 17667 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Bootstrap starting.
I20260808 07:04:20.378362 17665 tablet_bootstrap.cc:654] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:20.378537 17667 tablet_bootstrap.cc:654] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:20.378816 17665 log.cc:824] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:20.379017 17667 log.cc:824] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:20.379567 17665 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: No bootstrap required, opened a new log
I20260808 07:04:20.379627 17665 ts_tablet_manager.cc:1397] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:20.379762 17667 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: No bootstrap required, opened a new log
I20260808 07:04:20.379822 17667 ts_tablet_manager.cc:1397] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:20.380944 17665 raft_consensus.cc:348] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.381104 17665 raft_consensus.cc:374] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:20.381160 17665 raft_consensus.cc:729] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf442794d6134c8b89b0a52ebcfce38e, State: Initialized, Role: FOLLOWER
I20260808 07:04:20.381222 17667 raft_consensus.cc:348] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.381297 17665 consensus_queue.cc:260] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.381377 17667 raft_consensus.cc:374] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:20.381402 17667 raft_consensus.cc:729] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5aefb5d7d4b4027bf3f99107a2c70c8, State: Initialized, Role: FOLLOWER
I20260808 07:04:20.381493 17667 consensus_queue.cc:260] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.381575 17665 ts_tablet_manager.cc:1428] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:20.381646 17653 heartbeater.cc:503] Master 127.26.23.190:42337 was elected leader, sending a full tablet report...
I20260808 07:04:20.381758 17667 ts_tablet_manager.cc:1428] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:20.381784 17458 heartbeater.cc:503] Master 127.26.23.190:42337 was elected leader, sending a full tablet report...
W20260808 07:04:20.450397 17459 tablet.cc:2369] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:20.458776 17670 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:20.458901 17670 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.459291 17670 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729)
I20260808 07:04:20.463038 17656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.459461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:36767 (local address 127.26.23.131:49899)
0808 07:04:20.459524 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.459535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.459592 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.459764 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.459765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.459767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:20.459846 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.459848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.460766 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.460767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.462014 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.462018 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.462818 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.462819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.462896 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.462900 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.462950 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.462984 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":23}
I20260808 07:04:20.463074 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.459570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:49899 (local address 127.26.23.130:36767)
0808 07:04:20.459619 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.459621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.459631 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:04:20.459662 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.459663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.459672 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.459726 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:20.459917 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.460675 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.462109 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.462720 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.462799 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.462809 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.462966 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.463005 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:04:20.463394 17376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11960da7ce0f4c00a0ec226edf0b5ac1" candidate_uuid: "cf442794d6134c8b89b0a52ebcfce38e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" is_pre_election: true
I20260808 07:04:20.463501 17674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.459564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41729 (local address 127.26.23.131:49601)
0808 07:04:20.459757 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.459766 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.459825 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.459942 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:20.459942 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:20.459944 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:20.460001 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.460002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.460836 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.460837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.462014 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:20.462025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.463265 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.463266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:20.463334 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.463337 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:04:20.463382 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:04:20.463422 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":133,"threads_started":1}
I20260808 07:04:20.463507 17248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.459654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:49601 (local address 127.26.23.129:41729)
0808 07:04:20.459713 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.459715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.459830 (+ 115us) server_negotiation.cc:407] Connection header received
0808 07:04:20.459868 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.459869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.459877 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.459926 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:20.460081 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.460767 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.462108 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.463153 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.463221 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.463229 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.463404 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.463449 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 07:04:20.463616 17376 raft_consensus.cc:2454] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf442794d6134c8b89b0a52ebcfce38e in term 0.
I20260808 07:04:20.463871 17487 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e; no voters:
I20260808 07:04:20.463953 17169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11960da7ce0f4c00a0ec226edf0b5ac1" candidate_uuid: "cf442794d6134c8b89b0a52ebcfce38e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cbc558d1e1340e6954a7a6f782035b2" is_pre_election: true
I20260808 07:04:20.464040 17670 raft_consensus.cc:2781] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:04:20.464107 17169 raft_consensus.cc:2454] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf442794d6134c8b89b0a52ebcfce38e in term 0.
I20260808 07:04:20.464119 17670 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:04:20.464154 17670 raft_consensus.cc:3037] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:20.464951 17670 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.465061 17670 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [CANDIDATE]: Term 1 election: Requested vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729)
I20260808 07:04:20.465234 17376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11960da7ce0f4c00a0ec226edf0b5ac1" candidate_uuid: "cf442794d6134c8b89b0a52ebcfce38e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8"
I20260808 07:04:20.465247 17169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11960da7ce0f4c00a0ec226edf0b5ac1" candidate_uuid: "cf442794d6134c8b89b0a52ebcfce38e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cbc558d1e1340e6954a7a6f782035b2"
I20260808 07:04:20.465314 17376 raft_consensus.cc:3037] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:20.465317 17169 raft_consensus.cc:3037] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:20.466007 17376 raft_consensus.cc:2454] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf442794d6134c8b89b0a52ebcfce38e in term 1.
I20260808 07:04:20.466048 17169 raft_consensus.cc:2454] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf442794d6134c8b89b0a52ebcfce38e in term 1.
I20260808 07:04:20.466198 17487 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e; no voters:
I20260808 07:04:20.466315 17670 raft_consensus.cc:2781] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:20.466472 17670 raft_consensus.cc:686] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 LEADER]: Becoming Leader. State: Replica: cf442794d6134c8b89b0a52ebcfce38e, State: Running, Role: LEADER
I20260808 07:04:20.466574 17670 consensus_queue.cc:237] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.467358 16958 catalog_manager.cc:5495] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e reported cstate change: term changed from 0 to 1, leader changed from <none> to cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131). New cstate: current_term: 1 leader_uuid: "cf442794d6134c8b89b0a52ebcfce38e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } health_report { overall_health: UNKNOWN } } }
I20260808 07:04:20.487560 17662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.485429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38556 (local address 127.26.23.131:40151)
0808 07:04:20.485481 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:20.485483 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:20.485493 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:04:20.485539 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:20.485540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:20.485560 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:20.485631 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:20.485742 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.486256 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.486932 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:20.487158 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:20.487207 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:20.487325 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:20.487418 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:04:20.487471 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:20.487489 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 07:04:20.487506 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:04:20.489290 17169 raft_consensus.cc:1261] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Refusing update from remote peer cf442794d6134c8b89b0a52ebcfce38e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:20.489290 17376 raft_consensus.cc:1261] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Refusing update from remote peer cf442794d6134c8b89b0a52ebcfce38e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:20.489614 17670 consensus_queue.cc:1035] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:20.489756 17675 consensus_queue.cc:1035] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:20.492229 17683 mvcc.cc:205] Tried to move back new op lower bound from 7316163217361559552 to 7316163217271734272. Current Snapshot: MvccSnapshot[applied={T|T < 7316163217361559552}]
I20260808 07:04:20.494226 16958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:20.494313 16958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54564:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:20.494987 16958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Sending DeleteTablet for 3 replicas of tablet 11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:20.495347 17343 tablet_service.cc:1514] Processing DeleteTablet for tablet 11960da7ce0f4c00a0ec226edf0b5ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:20 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38370
I20260808 07:04:20.495388 17139 tablet_service.cc:1514] Processing DeleteTablet for tablet 11960da7ce0f4c00a0ec226edf0b5ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:20 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:56966
I20260808 07:04:20.495434 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 17016
I20260808 07:04:20.495492 17557 tablet_service.cc:1514] Processing DeleteTablet for tablet 11960da7ce0f4c00a0ec226edf0b5ac1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:20 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38540
I20260808 07:04:20.495653 17250 tablet_replica.cc:330] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: stopping tablet replica
I20260808 07:04:20.495710 17250 raft_consensus.cc:2229] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:20.495762 17250 raft_consensus.cc:2258] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:20.500957 17691 tablet_replica.cc:330] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: stopping tablet replica
I20260808 07:04:20.501078 17691 raft_consensus.cc:2229] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:20.501199 17691 raft_consensus.cc:2258] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:20.502117 17691 ts_tablet_manager.cc:1905] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:20.503723 17691 ts_tablet_manager.cc:1918] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:20.503805 17691 log.cc:1196] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:20.504066 17691 ts_tablet_manager.cc:1939] T 11960da7ce0f4c00a0ec226edf0b5ac1 P c5aefb5d7d4b4027bf3f99107a2c70c8: Deleting consensus metadata
I20260808 07:04:20.504462 16935 catalog_manager.cc:4841] TS c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): tablet 11960da7ce0f4c00a0ec226edf0b5ac1 (table test-table [id=bc2c0579380a405bbdbb8b448509ee40]) successfully deleted
I20260808 07:04:20.510555 17692 tablet_replica.cc:330] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: stopping tablet replica
I20260808 07:04:20.510679 17692 raft_consensus.cc:2229] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:04:20.510789 17692 raft_consensus.cc:2258] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 07:04:20.515616 16935 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:41729 (error 108)
I20260808 07:04:20.515890 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 17243
I20260808 07:04:20.516114 17692 ts_tablet_manager.cc:1905] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:20.516368 17660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.516231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:41729 (local address 127.0.0.1:56972)
0808 07:04:20.516299 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.516329 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:41729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 07:04:20.516624 16935 catalog_manager.cc:4584] TS 0cbc558d1e1340e6954a7a6f782035b2 (127.26.23.129:41729): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 11960da7ce0f4c00a0ec226edf0b5ac1: Network error: Client connection negotiation failed: client connection to 127.26.23.129:41729: connect: Connection refused (error 111)
I20260808 07:04:20.522234 17692 ts_tablet_manager.cc:1918] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:20.522327 17692 log.cc:1196] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:20.522588 17692 ts_tablet_manager.cc:1939] T 11960da7ce0f4c00a0ec226edf0b5ac1 P cf442794d6134c8b89b0a52ebcfce38e: Deleting consensus metadata
I20260808 07:04:20.523034 16933 catalog_manager.cc:4841] TS cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): tablet 11960da7ce0f4c00a0ec226edf0b5ac1 (table test-table [id=bc2c0579380a405bbdbb8b448509ee40]) successfully deleted
I20260808 07:04:20.527488 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 17462
I20260808 07:04:20.544467 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 16906
I20260808 07:04:20.556231 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42337
--webserver_interface=127.26.23.190
--webserver_port=45335
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:42337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:20.637560 17694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:20.637755 17694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:20.637776 17694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:20.638908 17694 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:20.638950 17694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:20.638963 17694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:20.638974 17694 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:20.638985 17694 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:20.640476 17694 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:42337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:42337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=45335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:20.640689 17694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:20.640909 17694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:20.645529 17701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.645526 17700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.645756 17694 server_base.cc:1034] running on GCE node
W20260808 07:04:20.645598 17703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.646076 17694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:20.646364 17694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:20.647516 17694 hybrid_clock.cc:648] HybridClock initialized: now 1786172660647502 us; error 29 us; skew 500 ppm
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:20.649986 17694 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:20.650413 17694 webserver.cc:460] Webserver started at http://127.26.23.190:45335/ using document root <none> and password file <none>
I20260808 07:04:20.650605 17694 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:20.650645 17694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:20.651849 17694 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:20.652426 17715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.652565 17694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:20.652647 17694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "18c9e4d8cb024da7bad1e0c30cc227e1"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "81254bc5450dd3cf44c000d676eec66c"
server_key_iv: "693085d6aa33e4c9e23e750d2b9cf674"
server_key_version: "encryptionkey@0"
I20260808 07:04:20.652951 17694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:20.662114 17694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:20.664243 17694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:20.664366 17694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:20.668419 17694 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:42337
I20260808 07:04:20.668452 17794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:42337 every 8 connection(s)
I20260808 07:04:20.668807 17694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:20.670451 17795 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:04:20.671100 17795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap starting.
I20260808 07:04:20.671274 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 17694
I20260808 07:04:20.671583 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:41729
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:42337
--webserver_port=45901
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:20.680640 17795 log.cc:824] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:20.682837 17795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:20.683096 17795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1: Bootstrap complete.
I20260808 07:04:20.685212 17795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:20.685434 17795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c9e4d8cb024da7bad1e0c30cc227e1, State: Initialized, Role: FOLLOWER
I20260808 07:04:20.685593 17795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:20.685657 17795 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:20.685705 17795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:20.685752 17795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:04:20.686825 17795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:20.686918 17795 leader_election.cc:302] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18c9e4d8cb024da7bad1e0c30cc227e1; no voters:
I20260808 07:04:20.687072 17795 leader_election.cc:288] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 07:04:20.687111 17799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:04:20.687227 17799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [term 3 LEADER]: Becoming Leader. State: Replica: 18c9e4d8cb024da7bad1e0c30cc227e1, State: Running, Role: LEADER
I20260808 07:04:20.687325 17799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } }
I20260808 07:04:20.687353 17795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:20.687630 17800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } } }
I20260808 07:04:20.687788 17800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:20.688102 17801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18c9e4d8cb024da7bad1e0c30cc227e1. Latest consensus state: current_term: 3 leader_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18c9e4d8cb024da7bad1e0c30cc227e1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 42337 } } }
I20260808 07:04:20.688185 17801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c9e4d8cb024da7bad1e0c30cc227e1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:20.688366 17809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:20.689159 17809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:04:20.689275 17809 catalog_manager.cc:1259] Loaded cluster ID: f14d6741abdb4f89baa138112371bbe4
I20260808 07:04:20.689530 17809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 07:04:20.689760 17809 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc776e379ad google::LogMessage::Fail() at ??:0
@ 0x7fc776e3a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc776e374de google::LogMessage::Flush() at ??:0
@ 0x7fc776e38a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc77ed580f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc77ed618b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc778d050d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc778cfa954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc779b5e6db start_thread at ??:0
@ 0x7fc77593561f clone at ??:0
W20260808 07:04:20.767673 17797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:20.767868 17797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:20.767890 17797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:20.769037 17797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:20.769080 17797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:20.769106 17797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:20.770604 17797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:41729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=45901
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:20.770859 17797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:20.771073 17797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:20.777097 17850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.777163 17854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.777150 17856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.777694 17797 server_base.cc:1034] running on GCE node
I20260808 07:04:20.777878 17797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:20.778097 17797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:20.779268 17797 hybrid_clock.cc:648] HybridClock initialized: now 1786172660779253 us; error 31 us; skew 500 ppm
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:20.781782 17797 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:20.782353 17797 webserver.cc:460] Webserver started at http://127.26.23.129:45901/ using document root <none> and password file <none>
I20260808 07:04:20.782616 17797 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:20.782684 17797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:20.784417 17797 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:04:20.785146 17866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.785305 17797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:20.785382 17797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "0cbc558d1e1340e6954a7a6f782035b2"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "555a62f38658d1b5b27b5445f036e3b2"
server_key_iv: "6c15d061bc0b32b575ef6d13263a024d"
server_key_version: "encryptionkey@0"
I20260808 07:04:20.785774 17797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:20.813479 17797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:20.815704 17797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:20.815828 17797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:20.816063 17797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:20.816500 17874 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:04:20.818527 17797 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:04:20.818589 17797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:04:20.818655 17797 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:04:20.819294 17797 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:04:20.819329 17797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:20.819414 17874 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap starting.
I20260808 07:04:20.825788 17797 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:41729
I20260808 07:04:20.826169 17797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:04:20.826406 18042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:41729 every 8 connection(s)
I20260808 07:04:20.827971 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 17797
I20260808 07:04:20.828212 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:36767
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:42337
--webserver_port=39019
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:20.831240 17874 log.cc:824] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:20.833917 17874 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:20.834265 17874 tablet_bootstrap.cc:492] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Bootstrap complete.
I20260808 07:04:20.835457 17874 ts_tablet_manager.cc:1397] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.012s
I20260808 07:04:20.836828 17874 raft_consensus.cc:348] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.837219 17874 raft_consensus.cc:729] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cbc558d1e1340e6954a7a6f782035b2, State: Initialized, Role: FOLLOWER
I20260808 07:04:20.837383 17874 consensus_queue.cc:260] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:20.837666 17874 ts_tablet_manager.cc:1428] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260808 07:04:20.870266 18053 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:04:20.831971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:35925)
0808 07:04:20.832141 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.832184 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:20.832663 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:20.870035 (+ 37372us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
W20260808 07:04:20.870517 18043 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:42337 (0 consecutive failures): Network error: Failed to ping master at 127.26.23.190:42337: Client connection negotiation failed: client connection to 127.26.23.190:42337: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:04:20.870877 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.870734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:33827)
0808 07:04:20.870786 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.870843 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:04:20.871197 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.871117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:48549)
0808 07:04:20.871155 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.871179 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:04:20.871311 18043 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:04:20.913563 18050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:20.913753 18050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:20.913774 18050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:20.914968 18050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:20.915011 18050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:20.915040 18050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:20.916484 18050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:36767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=39019
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:20.916707 18050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:20.916930 18050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:04:20.921922 18050 server_base.cc:1034] running on GCE node
W20260808 07:04:20.921998 18063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.922056 18064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:20.921967 18066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:20.922358 18050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:20.922575 18050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:20.923717 18050 hybrid_clock.cc:648] HybridClock initialized: now 1786172660923699 us; error 33 us; skew 500 ppm
Aug 08 07:04:20 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:20.926311 18050 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:20.926751 18050 webserver.cc:460] Webserver started at http://127.26.23.130:39019/ using document root <none> and password file <none>
I20260808 07:04:20.926968 18050 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:20.927014 18050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:20.928262 18050 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:20.928815 18075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.928963 18050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.929054 18050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "807f6022f34c9726817c784d69b23e58"
server_key_iv: "02ccdd9225747ee5eb2a26b6c08ddcf7"
server_key_version: "encryptionkey@0"
I20260808 07:04:20.929391 18050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:20.944491 18050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:20.946336 18050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:20.946448 18050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:20.946638 18050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:20.946892 18050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:20.946921 18050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.946941 18050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:20.946957 18050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:20.952452 18050 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:36767
I20260808 07:04:20.952512 18258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:36767 every 8 connection(s)
I20260808 07:04:20.952832 18050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:04:20.953902 18261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.953512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:39227)
0808 07:04:20.953681 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.953763 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
W20260808 07:04:20.954306 18259 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:42337 (0 consecutive failures): Network error: Failed to ping master at 127.26.23.190:42337: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
I20260808 07:04:20.954566 18261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.954475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:38239)
0808 07:04:20.954516 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.954542 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:04:20.954839 18261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:20.954766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:49251)
0808 07:04:20.954799 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:20.954820 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:04:20.954929 18259 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:04:20.955191 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 18050
I20260808 07:04:20.955412 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:40151
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:42337
--webserver_port=43455
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:21.035677 18262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:21.035879 18262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:21.035909 18262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:21.037027 18262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:21.037070 18262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:21.037106 18262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:21.038537 18262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:40151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=43455
--tserver_master_addrs=127.26.23.190:42337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:21.038766 18262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:21.038969 18262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:21.043756 18276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:21.043754 18274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:21.043826 18273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:21.043931 18262 server_base.cc:1034] running on GCE node
I20260808 07:04:21.044139 18262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:21.044358 18262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:21.045492 18262 hybrid_clock.cc:648] HybridClock initialized: now 1786172661045475 us; error 34 us; skew 500 ppm
Aug 08 07:04:21 dist-test-slave-zj8q krb5kdc[16046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172661, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:21.047932 18262 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:21.048383 18262 webserver.cc:460] Webserver started at http://127.26.23.131:43455/ using document root <none> and password file <none>
I20260808 07:04:21.048578 18262 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:21.048628 18262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:21.049871 18262 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:21.050462 18285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:21.050591 18262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:21.050678 18262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "cf442794d6134c8b89b0a52ebcfce38e"
format_stamp: "Formatted at 2026-08-08 07:04:19 on dist-test-slave-zj8q"
server_key: "ea43a37115f6935da3dd448a097b352b"
server_key_iv: "34d5f1f0dad36589ab652e4c75ed2f91"
server_key_version: "encryptionkey@0"
I20260808 07:04:21.050989 18262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:21.077574 18262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:21.079782 18262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:21.079919 18262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:21.080150 18262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:21.080456 18262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:21.080489 18262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:21.080518 18262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:21.080534 18262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:21.086093 18262 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:40151
I20260808 07:04:21.086179 18474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:40151 every 8 connection(s)
I20260808 07:04:21.086519 18262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:04:21.087482 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:21.087116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:59059)
0808 07:04:21.087267 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:21.087343 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
W20260808 07:04:21.087831 18476 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:42337 (0 consecutive failures): Network error: Failed to ping master at 127.26.23.190:42337: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
I20260808 07:04:21.088069 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:21.087983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:53705)
0808 07:04:21.088020 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:21.088047 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 07:04:21.088289 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:21.088238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:55297)
0808 07:04:21.088258 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:21.088276 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260808 07:04:21.088372 18476 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:04:21.090718 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 18262
I20260808 07:04:21.871886 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:21.871668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:34943)
0808 07:04:21.871782 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:21.871817 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260808 07:04:21.955372 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:21.955192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:42037)
0808 07:04:21.955296 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:21.955324 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":55,"threads_started":1}
I20260808 07:04:22.089299 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.089091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:39513)
0808 07:04:22.089209 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:22.089239 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260808 07:04:22.110345 18487 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:22.110524 18487 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:22.110875 18487 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
Aug 08 07:04:22 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.130@KRBTEST.COM
Aug 08 07:04:22 dist-test-slave-zj8q krb5kdc[16046](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172660, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.131@KRBTEST.COM
I20260808 07:04:22.121196 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.111056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:40151 (local address 127.26.23.129:35103)
0808 07:04:22.111214 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:22.111223 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:22.111268 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:22.112074 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:22.112077 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:22.112457 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:22.112665 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:22.112671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.113741 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.113741 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:22.114583 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:22.114586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.115170 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.115171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:22.115275 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:22.115788 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:22.115795 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:22.117689 (+ 1894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:22.119530 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:22.119531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:22.119532 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:22.119750 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:22.120008 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:22.120009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:22.120009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:22.120177 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:22.120626 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:22.120631 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:22.120788 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 07:04:22.120900 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:04:22.121078 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":85,"thread_start_us":53,"threads_started":1}
I20260808 07:04:22.121210 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.111146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:35205 (local address 127.26.23.130:36767)
0808 07:04:22.111330 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:22.111342 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:22.111383 (+ 41us) server_negotiation.cc:407] Connection header received
0808 07:04:22.111897 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:22.111900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:22.111939 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:22.112063 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:22.112779 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.113629 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.114661 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.115085 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.115182 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:22.117464 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:22.117469 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:22.117470 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:22.117481 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:22.119284 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:22.119816 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:22.119819 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:22.119819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:22.119939 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:22.120239 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:22.120240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:22.120240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:22.120553 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:22.120643 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:22.120960 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 07:04:22.121095 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":72,"threads_started":1}
I20260808 07:04:22.121233 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.111223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:35103 (local address 127.26.23.131:40151)
0808 07:04:22.111378 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:22.111387 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:22.111412 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:04:22.111841 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:22.111843 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:22.111885 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:22.112011 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:22.112772 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.113633 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.114667 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.115080 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.115182 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:22.117789 (+ 2607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:22.117794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:22.117794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:22.117806 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:22.119468 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:22.119815 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:22.119817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:22.119818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:22.119939 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:22.120239 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:22.120240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:22.120240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:22.120553 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:22.120635 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:22.120960 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 07:04:22.121095 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260808 07:04:22.121472 18481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.111015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:36767 (local address 127.26.23.129:35205)
0808 07:04:22.111195 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:22.111206 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:22.111268 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:22.112080 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:22.112082 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:22.112458 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:22.112664 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:22.112670 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.113726 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.113726 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:22.114585 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:22.114587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:22.115169 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:22.115170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:22.115274 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:22.115844 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:22.115848 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:22.117351 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:22.119369 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:22.119378 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:22.119380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:22.119738 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:22.120008 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:22.120009 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:22.120009 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:22.120177 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:22.120655 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:22.120656 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:22.120788 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 07:04:22.120900 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:04:22.121142 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":149}
W20260808 07:04:22.122591 17867 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
W20260808 07:04:22.122684 17870 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:22.122761 17870 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cbc558d1e1340e6954a7a6f782035b2; no voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e
I20260808 07:04:22.122870 18487 raft_consensus.cc:2726] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:04:22.872542 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.872336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:58929)
0808 07:04:22.872463 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:22.872494 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260808 07:04:22.955998 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:22.955785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:38653)
0808 07:04:22.955920 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:22.955959 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260808 07:04:23.089924 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:23.089690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:55275)
0808 07:04:23.089840 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:23.089885 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":62,"threads_started":1}
I20260808 07:04:23.873239 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:23.873017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:33367)
0808 07:04:23.873148 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:23.873186 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260808 07:04:23.956646 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:23.956448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:41007)
0808 07:04:23.956566 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:23.956603 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260808 07:04:24.090579 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:24.090381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:42045)
0808 07:04:24.090499 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:24.090537 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":63,"threads_started":1}
I20260808 07:04:24.322037 18503 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:24.322186 18503 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:24.322371 18503 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
W20260808 07:04:24.322760 17867 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
W20260808 07:04:24.322860 17870 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:24.322921 17870 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cbc558d1e1340e6954a7a6f782035b2; no voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e
I20260808 07:04:24.323000 18503 raft_consensus.cc:2726] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:04:24.873896 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:24.873653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:37139)
0808 07:04:24.873808 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:24.873846 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":66,"threads_started":1}
I20260808 07:04:24.957252 18507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:24.957032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:42655)
0808 07:04:24.957171 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:24.957210 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":59,"threads_started":1}
I20260808 07:04:25.091187 18508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:25.090992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:50275)
0808 07:04:25.091113 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:25.091147 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260808 07:04:25.874670 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:25.874448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:55869)
0808 07:04:25.874578 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:25.874621 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260808 07:04:25.957899 18511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:25.957673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:34713)
0808 07:04:25.957813 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:25.957854 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":65,"threads_started":1}
I20260808 07:04:26.091851 18514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:26.091642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:34027)
0808 07:04:26.091771 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:26.091809 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260808 07:04:26.875365 18515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:26.875141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:58909)
0808 07:04:26.875278 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:26.875316 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":62,"threads_started":1}
I20260808 07:04:26.958546 18516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:26.958339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:57773)
0808 07:04:26.958470 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:26.958507 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260808 07:04:27.092507 18518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:27.092274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:33043)
0808 07:04:27.092400 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:27.092447 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260808 07:04:27.518472 18521 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:27.518584 18521 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:27.518743 18521 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
W20260808 07:04:27.519122 17870 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
W20260808 07:04:27.519205 17867 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:27.519280 17867 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cbc558d1e1340e6954a7a6f782035b2; no voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e
I20260808 07:04:27.519364 18521 raft_consensus.cc:2726] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:04:27.876068 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:27.875867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:42995)
0808 07:04:27.875984 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:27.876019 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260808 07:04:27.959157 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:27.958953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:43497)
0808 07:04:27.959074 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:27.959115 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":65,"threads_started":1}
I20260808 07:04:28.093246 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:28.093015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:40147)
0808 07:04:28.093164 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:28.093202 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260808 07:04:28.876770 18527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:28.876485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:35513)
0808 07:04:28.876684 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:28.876721 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":126,"threads_started":1}
I20260808 07:04:28.959736 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:28.959532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:36351)
0808 07:04:28.959661 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:28.959693 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260808 07:04:29.093931 18529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:29.093697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:54355)
0808 07:04:29.093851 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:29.093886 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
I20260808 07:04:29.579185 18530 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:29.579288 18530 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:29.579456 18530 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
W20260808 07:04:29.579797 17870 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
W20260808 07:04:29.579885 17867 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:29.579957 17867 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cbc558d1e1340e6954a7a6f782035b2; no voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e
I20260808 07:04:29.580034 18530 raft_consensus.cc:2726] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:04:29.877506 18531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:29.877240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:53797)
0808 07:04:29.877402 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:29.877452 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":65,"threads_started":1}
I20260808 07:04:29.960453 18533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:29.960212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:59731)
0808 07:04:29.960359 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:29.960408 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260808 07:04:30.094643 18537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:30.094412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:42229)
0808 07:04:30.094545 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:30.094593 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260808 07:04:30.878278 18539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:30.878007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:34303)
0808 07:04:30.878186 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:30.878227 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":67,"threads_started":1}
I20260808 07:04:30.961090 18540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:30.960886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:48745)
0808 07:04:30.961007 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:30.961044 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260808 07:04:31.095278 18543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:31.095039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:51743)
0808 07:04:31.095183 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:31.095222 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":88,"threads_started":1}
I20260808 07:04:31.878974 18544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:31.878739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:33073)
0808 07:04:31.878886 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:31.878926 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":65,"threads_started":1}
I20260808 07:04:31.961691 18545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:31.961481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:48415)
0808 07:04:31.961610 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:31.961647 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
I20260808 07:04:32.095922 18546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:32.095713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:38199)
0808 07:04:32.095845 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:32.095875 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260808 07:04:32.879627 18547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:32.879417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:59075)
0808 07:04:32.879541 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:32.879577 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260808 07:04:32.962359 18548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:32.962109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:35407)
0808 07:04:32.962260 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:32.962304 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260808 07:04:33.096557 18549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:33.096335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:36287)
0808 07:04:33.096474 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:33.096511 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260808 07:04:33.880405 18552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:33.880118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:52937)
0808 07:04:33.880310 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:33.880352 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":66,"threads_started":1}
I20260808 07:04:33.963002 18553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:33.962788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:56467)
0808 07:04:33.962923 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:33.962960 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":63,"threads_started":1}
I20260808 07:04:34.097296 18557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:34.097068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:45007)
0808 07:04:34.097209 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:34.097247 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260808 07:04:34.881043 18558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:34.880837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:50067)
0808 07:04:34.880964 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:34.880995 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260808 07:04:34.963629 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:34.963405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:49391)
0808 07:04:34.963542 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:34.963580 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":74,"threads_started":1}
I20260808 07:04:35.097975 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:35.097758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:51975)
0808 07:04:35.097890 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:35.097927 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260808 07:04:35.881752 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:35.881546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.129:52109)
0808 07:04:35.881671 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:35.881703 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260808 07:04:35.917260 18565 raft_consensus.cc:482] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:35.917366 18565 raft_consensus.cc:504] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5aefb5d7d4b4027bf3f99107a2c70c8" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 36767 } } peers { permanent_uuid: "cf442794d6134c8b89b0a52ebcfce38e" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 40151 } } peers { permanent_uuid: "0cbc558d1e1340e6954a7a6f782035b2" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 41729 } }
I20260808 07:04:35.917531 18565 leader_election.cc:288] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767), cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151)
W20260808 07:04:35.917914 17870 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c5aefb5d7d4b4027bf3f99107a2c70c8 (127.26.23.130:36767): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
W20260808 07:04:35.918004 17867 leader_election.cc:341] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cf442794d6134c8b89b0a52ebcfce38e (127.26.23.131:40151): Not found: Tablet not found: 11960da7ce0f4c00a0ec226edf0b5ac1
I20260808 07:04:35.918078 17867 leader_election.cc:302] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cbc558d1e1340e6954a7a6f782035b2; no voters: c5aefb5d7d4b4027bf3f99107a2c70c8, cf442794d6134c8b89b0a52ebcfce38e
I20260808 07:04:35.918133 18565 raft_consensus.cc:2726] T 11960da7ce0f4c00a0ec226edf0b5ac1 P 0cbc558d1e1340e6954a7a6f782035b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:04:35.964298 18566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:35.964065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.130:52211)
0808 07:04:35.964220 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:35.964256 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":78,"threads_started":1}
I20260808 07:04:36.098664 18567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:36.098403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:42337 (local address 127.26.23.131:55387)
0808 07:04:36.098554 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:36.098600 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:42337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
I20260808 07:04:36.098811 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 17797
I20260808 07:04:36.110394 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 18050
I20260808 07:04:36.124136 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 18262
2026-08-08T07:04:36Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18454 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:04:36 dist-test-slave-zj8q krb5kdc[18570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:04:36 dist-test-slave-zj8q krb5kdc[18570](info): set up 2 sockets
Aug 08 07:04:36 dist-test-slave-zj8q krb5kdc[18570](info): commencing operation
krb5kdc: starting...
W20260808 07:04:37.267753 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:04:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:04:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:04:37.383941 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39345
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:37.463442 18592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:37.463634 18592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:37.463654 18592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:37.464720 18592 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:04:37.464751 18592 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:04:37.464763 18592 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:04:37.464774 18592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:37.464785 18592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:37.464797 18592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:37.464807 18592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:37.464821 18592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:37.466288 18592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:37.466472 18592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:37.466646 18592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:37.471846 18603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:37.471874 18612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:37.472026 18592 server_base.cc:1034] running on GCE node
W20260808 07:04:37.471846 18599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:37.472365 18592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:37.472620 18592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:37.473755 18592 hybrid_clock.cc:648] HybridClock initialized: now 1786172677473741 us; error 30 us; skew 500 ppm
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:37.476140 18592 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:37.476504 18592 webserver.cc:460] Webserver started at http://127.26.23.190:34047/ using document root <none> and password file <none>
I20260808 07:04:37.476727 18592 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:37.476770 18592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:37.476862 18592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:37.477854 18592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "027a095bf7964d4e8ee3e0cf245aaaf3"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "3ff3d3738d9311d361db136e796a724f"
server_key_iv: "26d9e605fe8dce096ca279877044cd5a"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.478137 18592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "027a095bf7964d4e8ee3e0cf245aaaf3"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "3ff3d3738d9311d361db136e796a724f"
server_key_iv: "26d9e605fe8dce096ca279877044cd5a"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.479339 18592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:37.480006 18626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.480158 18592 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:37.480239 18592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "027a095bf7964d4e8ee3e0cf245aaaf3"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "3ff3d3738d9311d361db136e796a724f"
server_key_iv: "26d9e605fe8dce096ca279877044cd5a"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.480291 18592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:37.518817 18592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:37.520726 18592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:37.520844 18592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:37.524605 18592 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39345
I20260808 07:04:37.524659 18705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39345 every 8 connection(s)
I20260808 07:04:37.524981 18592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:37.525918 18706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:37.528358 18706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap starting.
I20260808 07:04:37.528421 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 18592
I20260808 07:04:37.528513 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:04:37.528707 26718 external_mini_cluster.cc:1428] Setting key 15d9f959a7b93bf94bf1394453405865
I20260808 07:04:37.528960 18706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:37.529290 18706 log.cc:824] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:37.529945 18706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: No bootstrap required, opened a new log
I20260808 07:04:37.531790 18706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:37.531922 18706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:37.531955 18706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027a095bf7964d4e8ee3e0cf245aaaf3, State: Initialized, Role: FOLLOWER
I20260808 07:04:37.532074 18706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:37.532162 18706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:37.532194 18706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:37.532240 18706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:37.532742 18706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:37.532837 18706 leader_election.cc:302] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 027a095bf7964d4e8ee3e0cf245aaaf3; no voters:
I20260808 07:04:37.533004 18706 leader_election.cc:288] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:04:37.533041 18714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:37.533205 18714 raft_consensus.cc:686] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 LEADER]: Becoming Leader. State: Replica: 027a095bf7964d4e8ee3e0cf245aaaf3, State: Running, Role: LEADER
I20260808 07:04:37.533289 18706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:37.533309 18714 consensus_queue.cc:237] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:37.533635 18714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 027a095bf7964d4e8ee3e0cf245aaaf3. Latest consensus state: current_term: 1 leader_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } } }
I20260808 07:04:37.533783 18714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:37.534238 18729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:37.534811 18729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:37.535475 18719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } } }
I20260808 07:04:37.535563 18719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:37.536375 18729 catalog_manager.cc:1347] Generated new cluster ID: 8e1c73ec8a44407f881f0c279eaa9801
I20260808 07:04:37.536428 18729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:37.538672 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:37.529164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50002 (local address 127.26.23.190:39345)
0808 07:04:37.529350 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:37.529359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:37.529386 (+ 27us) server_negotiation.cc:407] Connection header received
0808 07:04:37.529818 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:37.529826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:37.529875 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:37.530002 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:37.530685 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.531565 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.532425 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.532860 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.532966 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:37.535659 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:37.535663 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:37.535663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:37.535675 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:37.537271 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:37.537583 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:37.537586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:37.537586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:37.537674 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:37.537847 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:37.537848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:37.537848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:37.538072 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:37.538219 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:37.538336 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 07:04:37.538463 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260808 07:04:37.577025 18729 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:04:37.577575 18729 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:37.587072 18729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Generated new TSK 0
I20260808 07:04:37.587267 18729 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:04:37.621793 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39345
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:37.708904 18748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:37.709089 18748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:37.709112 18748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:37.710275 18748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:37.710325 18748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:37.710354 18748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:37.711814 18748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:37.712029 18748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:37.712249 18748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:37.717187 18756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:37.717198 18760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:37.717192 18757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:37.717375 18748 server_base.cc:1034] running on GCE node
I20260808 07:04:37.717562 18748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:37.717793 18748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:37.718930 18748 hybrid_clock.cc:648] HybridClock initialized: now 1786172677718917 us; error 28 us; skew 500 ppm
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:37.721487 18748 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:37.721890 18748 webserver.cc:460] Webserver started at http://127.26.23.129:44129/ using document root <none> and password file <none>
I20260808 07:04:37.722175 18748 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:37.722260 18748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:37.722397 18748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:37.723416 18748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "b8e3605f1e31461994f7dd640757a677"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "45d1ddfec55acce98fcc27a709a87378"
server_key_iv: "3113491680aab41169fd9accae267eb6"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.723744 18748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "b8e3605f1e31461994f7dd640757a677"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "45d1ddfec55acce98fcc27a709a87378"
server_key_iv: "3113491680aab41169fd9accae267eb6"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.724978 18748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:04:37.725677 18771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.725837 18748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:37.725920 18748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "b8e3605f1e31461994f7dd640757a677"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "45d1ddfec55acce98fcc27a709a87378"
server_key_iv: "3113491680aab41169fd9accae267eb6"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.725986 18748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:37.741627 18748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:37.743677 18748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:37.743811 18748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:37.744009 18748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:37.744302 18748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:37.744335 18748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.744362 18748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:37.744380 18748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.749862 18748 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:35197
I20260808 07:04:37.749905 18935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:35197 every 8 connection(s)
I20260808 07:04:37.750238 18748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:37.757620 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 18748
I20260808 07:04:37.757753 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:04:37.757943 26718 external_mini_cluster.cc:1428] Setting key 6ffbf7d4ef70e6c3a5e60d8d23825952
I20260808 07:04:37.759150 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:37.751010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:58151 (local address 127.26.23.190:39345)
0808 07:04:37.751095 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:37.751097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:37.751307 (+ 210us) server_negotiation.cc:407] Connection header received
0808 07:04:37.751789 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:37.751790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:37.751801 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:37.751853 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:37.752778 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.753290 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.754273 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.754493 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.754593 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:37.756534 (+ 1941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:37.756535 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:37.756536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:37.756543 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:37.757676 (+ 1133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:37.758105 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:37.758106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:37.758107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:37.758200 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:37.758459 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:37.758459 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:37.758460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:37.758641 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:37.758703 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:37.758970 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:04:37.759058 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 07:04:37.759330 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:37.750975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:58151)
0808 07:04:37.751185 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:37.751223 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:37.751699 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:37.751907 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:37.751910 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:37.752478 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:37.752685 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:37.752691 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.753355 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.753356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:37.754189 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:37.754192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.754598 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.754598 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:37.754694 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:37.755144 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:37.755153 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:37.756449 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:37.757757 (+ 1308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:37.757764 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:37.757766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:37.758026 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:37.758254 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:37.758254 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:37.758255 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:37.758398 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:37.758707 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:37.758715 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:37.758849 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 07:04:37.758937 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:04:37.759123 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":115,"threads_started":1}
I20260808 07:04:37.759737 18938 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39345
I20260808 07:04:37.759824 18938 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:37.760007 18938 heartbeater.cc:511] Master 127.26.23.190:39345 requested a full tablet report, sending...
I20260808 07:04:37.760587 18660 ts_manager.cc:194] Registered new tserver with Master: b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197)
I20260808 07:04:37.761427 18660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:58151
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:04:37.783033 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39345
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:37.864248 18945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:37.864498 18945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:37.864532 18945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:37.865940 18945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:37.865986 18945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:37.866012 18945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:37.867450 18945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:37.867637 18945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:37.867810 18945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:37.872522 18954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:37.872522 18955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:37.872558 18945 server_base.cc:1034] running on GCE node
W20260808 07:04:37.872568 18957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:37.872910 18945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:37.873111 18945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:37.874217 18945 hybrid_clock.cc:648] HybridClock initialized: now 1786172677874200 us; error 29 us; skew 500 ppm
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:37.876600 18945 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:37.877007 18945 webserver.cc:460] Webserver started at http://127.26.23.130:41789/ using document root <none> and password file <none>
I20260808 07:04:37.877215 18945 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:37.877264 18945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:37.877384 18945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:37.878448 18945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "913f888ae28b431bbdea058c70d688ef"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "96801d31a8ae07a336d2478f3398412b"
server_key_iv: "369e0c1f455aafe643a143fda8d273b1"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.878775 18945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "913f888ae28b431bbdea058c70d688ef"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "96801d31a8ae07a336d2478f3398412b"
server_key_iv: "369e0c1f455aafe643a143fda8d273b1"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.879969 18945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:04:37.880631 18968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.880781 18945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:37.880863 18945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "913f888ae28b431bbdea058c70d688ef"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "96801d31a8ae07a336d2478f3398412b"
server_key_iv: "369e0c1f455aafe643a143fda8d273b1"
server_key_version: "encryptionkey@0"
I20260808 07:04:37.880921 18945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:37.896557 18945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:37.898643 18945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:37.898779 18945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:37.898983 18945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:37.899276 18945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:37.899309 18945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.899338 18945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:37.899355 18945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:37.904858 18945 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:38679
I20260808 07:04:37.904922 19141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:38679 every 8 connection(s)
I20260808 07:04:37.905200 18945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:04:37.907922 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 18945
I20260808 07:04:37.908015 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:04:37.908206 26718 external_mini_cluster.cc:1428] Setting key bcaa371b82842d891cf86da519b26b01
Aug 08 07:04:37 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172677, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:37.914744 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:37.905871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:46099 (local address 127.26.23.190:39345)
0808 07:04:37.905937 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:37.905939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:37.906185 (+ 246us) server_negotiation.cc:407] Connection header received
0808 07:04:37.906648 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:37.906650 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:37.906661 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:37.906725 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:37.907606 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.908149 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.909405 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.909603 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.909661 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:37.912120 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:37.912121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:37.912122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:37.912130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:37.913329 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:37.913745 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:37.913747 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:37.913747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:37.913815 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:37.914080 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:37.914081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:37.914081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:37.914236 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:37.914292 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:37.914602 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 07:04:37.914679 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:04:37.914997 19145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:37.905817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:46099)
0808 07:04:37.905990 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:37.906032 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:37.906562 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:37.906786 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:37.906789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:37.907346 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:37.907533 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:37.907538 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.908236 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.908237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:37.909329 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:37.909333 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:37.909684 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:37.909685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:37.909827 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:37.910326 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:37.910336 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:37.912030 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:37.913402 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:37.913409 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:37.913411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:37.913663 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:37.913883 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:37.913883 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:37.913883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:37.914015 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:37.914296 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:37.914303 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:37.914467 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 07:04:37.914590 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 07:04:37.914772 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260808 07:04:37.915489 19142 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39345
I20260808 07:04:37.915587 19142 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:37.915786 19142 heartbeater.cc:511] Master 127.26.23.190:39345 requested a full tablet report, sending...
I20260808 07:04:37.916153 18660 ts_manager.cc:194] Registered new tserver with Master: 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679)
I20260808 07:04:37.916507 18660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:46099
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:04:37.933027 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39345
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:38.012144 19149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:38.012326 19149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:38.012346 19149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:38.013484 19149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:38.013526 19149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:38.013558 19149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:38.015561 19149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:38.015795 19149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:38.016045 19149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:38.021436 19155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:38.021428 19158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:38.021562 19149 server_base.cc:1034] running on GCE node
W20260808 07:04:38.021449 19156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:38.021855 19149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:38.022047 19149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:38.023177 19149 hybrid_clock.cc:648] HybridClock initialized: now 1786172678023171 us; error 39 us; skew 500 ppm
Aug 08 07:04:38 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172678, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:38.025492 19149 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:38.025949 19149 webserver.cc:460] Webserver started at http://127.26.23.131:37409/ using document root <none> and password file <none>
I20260808 07:04:38.026191 19149 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:38.026252 19149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:38.026379 19149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:04:38.027398 19149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "5738ec07836248daae77b8afb4d5833a"
format_stamp: "Formatted at 2026-08-08 07:04:38 on dist-test-slave-zj8q"
server_key: "a9449fe8e05c0bb659869b12d9eb71cd"
server_key_iv: "ccc9f1b65363bcd2f1f26fb1ce2b1753"
server_key_version: "encryptionkey@0"
I20260808 07:04:38.027741 19149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "5738ec07836248daae77b8afb4d5833a"
format_stamp: "Formatted at 2026-08-08 07:04:38 on dist-test-slave-zj8q"
server_key: "a9449fe8e05c0bb659869b12d9eb71cd"
server_key_iv: "ccc9f1b65363bcd2f1f26fb1ce2b1753"
server_key_version: "encryptionkey@0"
I20260808 07:04:38.029033 19149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:04:38.029749 19166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:38.029901 19149 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:38.029985 19149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "5738ec07836248daae77b8afb4d5833a"
format_stamp: "Formatted at 2026-08-08 07:04:38 on dist-test-slave-zj8q"
server_key: "a9449fe8e05c0bb659869b12d9eb71cd"
server_key_iv: "ccc9f1b65363bcd2f1f26fb1ce2b1753"
server_key_version: "encryptionkey@0"
I20260808 07:04:38.030052 19149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:38.044514 19149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:38.046372 19149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:38.046499 19149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:38.046691 19149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:38.046973 19149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:38.047006 19149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:38.047035 19149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:38.047057 19149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:38.052680 19149 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:45163
I20260808 07:04:38.052743 19343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:45163 every 8 connection(s)
I20260808 07:04:38.053026 19149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:04:38.057674 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 19149
I20260808 07:04:38.057765 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:04:38.057965 26718 external_mini_cluster.cc:1428] Setting key 836eb5c2ca76219c73acb138f3c15be7
Aug 08 07:04:38 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172678, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:38.061878 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.053705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:43335 (local address 127.26.23.190:39345)
0808 07:04:38.053780 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.053783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.053953 (+ 170us) server_negotiation.cc:407] Connection header received
0808 07:04:38.054518 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.054520 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.054531 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.054570 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:38.055521 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.056038 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.056986 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.057181 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.057228 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.059484 (+ 2256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:38.059486 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:38.059486 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:38.059492 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:38.060803 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:38.061153 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:38.061154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:38.061155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:38.061209 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:38.061399 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:38.061399 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:38.061400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:38.061499 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:38.061546 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.061744 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.061814 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 07:04:38.062026 19347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.053680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:43335)
0808 07:04:38.053843 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.053878 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:38.054422 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:38.054640 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:38.054643 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:38.055248 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:38.055442 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.055448 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.056103 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.056103 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.056915 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.056917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.057239 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.057239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.057341 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.057788 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:38.057798 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:38.059407 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:38.060876 (+ 1469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:38.060882 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:38.060884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:38.061088 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:38.061257 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:38.061257 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:38.061258 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:38.061347 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:38.061542 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:38.061545 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:38.061653 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 07:04:38.061723 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 07:04:38.061839 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
I20260808 07:04:38.062472 19344 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39345
I20260808 07:04:38.062556 19344 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:38.062727 19344 heartbeater.cc:511] Master 127.26.23.190:39345 requested a full tablet report, sending...
I20260808 07:04:38.063053 18660 ts_manager.cc:194] Registered new tserver with Master: 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163)
I20260808 07:04:38.063408 18660 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:43335
I20260808 07:04:38.069654 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:04:38.076170 18711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.070946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50018 (local address 127.26.23.190:39345)
0808 07:04:38.070994 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.070997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.071096 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:04:38.071144 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.071144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.071152 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.071207 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:38.071697 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.072154 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.072877 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.073055 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.073099 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.074102 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:38.074103 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:38.074103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:38.074109 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:38.075348 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:38.075610 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:38.075611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:38.075611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:38.075654 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:38.075791 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:38.075792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:38.075792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:38.075915 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:38.075984 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.076052 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.076107 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:04:38.077520 18660 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:04:38.079146 18660 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:04:38.085322 19357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.081086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45163 (local address 127.0.0.1:57974)
0808 07:04:38.081485 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.081494 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:38.081547 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:38.081745 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:38.081748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:38.081751 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:38.081803 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.081804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.082890 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.082891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.084242 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.084245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.085024 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.085026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.085113 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.085131 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 07:04:38.085192 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:04:38.085245 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":5,"thread_start_us":75,"threads_started":1}
I20260808 07:04:38.085333 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.081179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57974 (local address 127.26.23.131:45163)
0808 07:04:38.081357 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.081362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.081599 (+ 237us) server_negotiation.cc:407] Connection header received
0808 07:04:38.081650 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.081652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.081666 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.081735 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:38.081879 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.082808 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.084336 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.084948 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.085013 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.085071 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.085215 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.085254 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":89,"threads_started":1}
I20260808 07:04:38.085671 19358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.081295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:35197 (local address 127.0.0.1:45650)
0808 07:04:38.081813 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.081823 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:38.081931 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:38.082237 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:38.082238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:38.082240 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:38.082274 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.082275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.083488 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.083489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.084385 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.084387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.085368 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.085369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.085435 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.085441 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:04:38.085489 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:04:38.085549 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":6,"thread_start_us":46,"threads_started":1}
I20260808 07:04:38.085717 19364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.081504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45650 (local address 127.26.23.129:35197)
0808 07:04:38.081666 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.081678 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.081889 (+ 211us) server_negotiation.cc:407] Connection header received
0808 07:04:38.082029 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.082032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.082048 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.082113 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:38.082355 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.083406 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.084472 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.085208 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.085276 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.085329 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.085595 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.085639 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
I20260808 07:04:38.085749 19359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.081179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43476 (local address 127.26.23.130:38679)
0808 07:04:38.081451 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.081455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.081467 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:04:38.081570 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.081572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.081588 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.081663 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:38.081916 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.083166 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.084438 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.085208 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.085276 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.085329 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.085634 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.085677 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":91,"threads_started":1}
I20260808 07:04:38.085883 19363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.081086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:38679 (local address 127.0.0.1:43476)
0808 07:04:38.081386 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.081416 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:38.081480 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:38.081753 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:38.081754 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:38.081757 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:38.081833 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.081836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.083255 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.083256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.084362 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.084364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.085367 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.085368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.085435 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.085443 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:04:38.085489 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:04:38.085549 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":4,"thread_start_us":80,"threads_started":1}
I20260808 07:04:38.086372 19240 tablet_service.cc:1467] Processing CreateTablet for tablet 408976d82c4b445c8069cabc2a95a681 (DEFAULT_TABLE table=test-table [id=d562da98e68b4a5494f1e7ecd3c3e685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:38.086628 19041 tablet_service.cc:1467] Processing CreateTablet for tablet 408976d82c4b445c8069cabc2a95a681 (DEFAULT_TABLE table=test-table [id=d562da98e68b4a5494f1e7ecd3c3e685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:38.086772 19240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408976d82c4b445c8069cabc2a95a681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:38.086938 19041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408976d82c4b445c8069cabc2a95a681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:38.090068 19367 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Bootstrap starting.
I20260808 07:04:38.090436 19366 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Bootstrap starting.
I20260808 07:04:38.090421 18840 tablet_service.cc:1467] Processing CreateTablet for tablet 408976d82c4b445c8069cabc2a95a681 (DEFAULT_TABLE table=test-table [id=d562da98e68b4a5494f1e7ecd3c3e685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:38.090704 18840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 408976d82c4b445c8069cabc2a95a681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:38.090873 19367 tablet_bootstrap.cc:654] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:38.091092 19366 tablet_bootstrap.cc:654] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:38.091454 19367 log.cc:824] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:38.091672 19366 log.cc:824] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:38.092319 19367 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: No bootstrap required, opened a new log
I20260808 07:04:38.092381 19366 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: No bootstrap required, opened a new log
I20260808 07:04:38.092397 19367 ts_tablet_manager.cc:1397] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:38.092446 19366 ts_tablet_manager.cc:1397] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:38.093724 19370 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Bootstrap starting.
I20260808 07:04:38.093822 19366 raft_consensus.cc:348] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.094005 19366 raft_consensus.cc:374] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:38.094058 19366 raft_consensus.cc:729] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 913f888ae28b431bbdea058c70d688ef, State: Initialized, Role: FOLLOWER
I20260808 07:04:38.094208 19366 consensus_queue.cc:260] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.094241 19367 raft_consensus.cc:348] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.094408 19367 raft_consensus.cc:374] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:38.094452 19367 raft_consensus.cc:729] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5738ec07836248daae77b8afb4d5833a, State: Initialized, Role: FOLLOWER
I20260808 07:04:38.094455 19370 tablet_bootstrap.cc:654] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:38.094486 19366 ts_tablet_manager.cc:1428] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:04:38.094580 19367 consensus_queue.cc:260] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.094656 19142 heartbeater.cc:503] Master 127.26.23.190:39345 was elected leader, sending a full tablet report...
I20260808 07:04:38.094844 19367 ts_tablet_manager.cc:1428] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:04:38.094941 19344 heartbeater.cc:503] Master 127.26.23.190:39345 was elected leader, sending a full tablet report...
I20260808 07:04:38.094997 19370 log.cc:824] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:38.095793 19370 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: No bootstrap required, opened a new log
I20260808 07:04:38.095863 19370 ts_tablet_manager.cc:1397] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:04:38.097203 19370 raft_consensus.cc:348] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.097332 19370 raft_consensus.cc:374] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:38.097363 19370 raft_consensus.cc:729] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e3605f1e31461994f7dd640757a677, State: Initialized, Role: FOLLOWER
I20260808 07:04:38.097471 19370 consensus_queue.cc:260] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.097699 19370 ts_tablet_manager.cc:1428] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:04:38.097750 18938 heartbeater.cc:503] Master 127.26.23.190:39345 was elected leader, sending a full tablet report...
W20260808 07:04:38.155824 19143 tablet.cc:2369] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:04:38.250996 18939 tablet.cc:2369] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:04:38.303612 19345 tablet.cc:2369] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:38.496382 19371 raft_consensus.cc:482] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:38.496518 19371 raft_consensus.cc:504] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.496840 19371 leader_election.cc:288] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163), b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197)
I20260808 07:04:38.500806 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.497133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:33187 (local address 127.26.23.131:45163)
0808 07:04:38.497209 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.497211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.497222 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:04:38.497302 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.497304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.497314 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.497363 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:38.497567 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.498378 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.499862 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.500432 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.500504 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.500513 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.500688 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.500733 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 07:04:38.500818 19364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.497322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:39963 (local address 127.26.23.129:35197)
0808 07:04:38.497377 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.497379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.497390 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:04:38.497441 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.497443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.497450 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.497488 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:38.497604 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.498378 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.499862 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.500426 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.500503 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.500513 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.500719 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.500760 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:04:38.500850 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.497216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:35197 (local address 127.26.23.130:39963)
0808 07:04:38.497319 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.497329 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:38.497389 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:38.497496 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:38.497496 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:38.497498 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:38.497548 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.497549 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.498472 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.498473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.499765 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.499768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.500519 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.500521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.500651 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.500655 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:38.500705 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:04:38.500735 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":93,"thread_start_us":43,"threads_started":1}
I20260808 07:04:38.500850 19376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.497023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45163 (local address 127.26.23.130:33187)
0808 07:04:38.497144 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.497156 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:38.497236 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:38.497397 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:38.497398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:38.497401 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:38.497496 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.497499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.498460 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.498461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.499765 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:38.499768 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.500521 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.500521 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:38.500612 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.500618 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:04:38.500677 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:04:38.500728 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":9,"thread_start_us":70,"threads_started":1}
I20260808 07:04:38.501173 18864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408976d82c4b445c8069cabc2a95a681" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8e3605f1e31461994f7dd640757a677" is_pre_election: true
I20260808 07:04:38.501322 18864 raft_consensus.cc:2454] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 0.
I20260808 07:04:38.501590 18972 leader_election.cc:302] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 913f888ae28b431bbdea058c70d688ef, b8e3605f1e31461994f7dd640757a677; no voters:
I20260808 07:04:38.501612 19270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408976d82c4b445c8069cabc2a95a681" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5738ec07836248daae77b8afb4d5833a" is_pre_election: true
I20260808 07:04:38.501765 19270 raft_consensus.cc:2454] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 0.
I20260808 07:04:38.501757 19371 raft_consensus.cc:2781] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:04:38.501833 19371 raft_consensus.cc:482] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:04:38.501868 19371 raft_consensus.cc:3037] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:38.502728 19371 raft_consensus.cc:504] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.502857 19371 leader_election.cc:288] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 election: Requested vote from peers 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163), b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197)
I20260808 07:04:38.503050 18864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408976d82c4b445c8069cabc2a95a681" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8e3605f1e31461994f7dd640757a677"
I20260808 07:04:38.503042 19270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "408976d82c4b445c8069cabc2a95a681" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5738ec07836248daae77b8afb4d5833a"
I20260808 07:04:38.503134 19270 raft_consensus.cc:3037] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:38.503153 18864 raft_consensus.cc:3037] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:38.504038 18864 raft_consensus.cc:2454] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 1.
I20260808 07:04:38.504038 19270 raft_consensus.cc:2454] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 1.
I20260808 07:04:38.504230 18972 leader_election.cc:302] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 913f888ae28b431bbdea058c70d688ef, b8e3605f1e31461994f7dd640757a677; no voters:
I20260808 07:04:38.504311 19371 raft_consensus.cc:2781] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:38.504469 19371 raft_consensus.cc:686] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 1 LEADER]: Becoming Leader. State: Replica: 913f888ae28b431bbdea058c70d688ef, State: Running, Role: LEADER
I20260808 07:04:38.504561 19371 consensus_queue.cc:237] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:38.505389 18660 catalog_manager.cc:5495] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 913f888ae28b431bbdea058c70d688ef (127.26.23.130). New cstate: current_term: 1 leader_uuid: "913f888ae28b431bbdea058c70d688ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } health_report { overall_health: UNKNOWN } } }
I20260808 07:04:38.529086 19359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.526820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43492 (local address 127.26.23.130:38679)
0808 07:04:38.526876 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:38.526877 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:38.526885 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:04:38.526944 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:38.526945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:38.526965 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:38.527028 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:38.527155 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.527632 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.528369 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:38.528568 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:38.528632 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:38.528787 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:38.528884 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:04:38.528953 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:38.528992 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:04:38.529013 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:04:38.531095 19270 raft_consensus.cc:1261] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Refusing update from remote peer 913f888ae28b431bbdea058c70d688ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:38.531121 18864 raft_consensus.cc:1261] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Refusing update from remote peer 913f888ae28b431bbdea058c70d688ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:38.531422 19378 consensus_queue.cc:1035] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:38.531551 19371 consensus_queue.cc:1035] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:38.534845 19385 mvcc.cc:205] Tried to move back new op lower bound from 7316163291260469248 to 7316163291155296256. Current Snapshot: MvccSnapshot[applied={T|T < 7316163291260469248 or (T in {7316163291260469248})}]
I20260808 07:04:38.535907 18658 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:38.535989 18658 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:38.536656 18658 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Sending DeleteTablet for 3 replicas of tablet 408976d82c4b445c8069cabc2a95a681
I20260808 07:04:38.536952 19041 tablet_service.cc:1514] Processing DeleteTablet for tablet 408976d82c4b445c8069cabc2a95a681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:38 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:43476
I20260808 07:04:38.536983 18840 tablet_service.cc:1514] Processing DeleteTablet for tablet 408976d82c4b445c8069cabc2a95a681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:38 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:45650
I20260808 07:04:38.537038 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 18748
I20260808 07:04:38.540904 19399 tablet_replica.cc:330] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: stopping tablet replica
I20260808 07:04:38.540995 19399 raft_consensus.cc:2229] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:04:38.541069 19399 raft_consensus.cc:2258] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:38.543853 19240 tablet_service.cc:1514] Processing DeleteTablet for tablet 408976d82c4b445c8069cabc2a95a681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:38 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:57974
I20260808 07:04:38.544013 19399 ts_tablet_manager.cc:1905] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:38.545691 19399 ts_tablet_manager.cc:1918] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:38.545761 19399 log.cc:1196] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/408976d82c4b445c8069cabc2a95a681
I20260808 07:04:38.546041 19399 ts_tablet_manager.cc:1939] T 408976d82c4b445c8069cabc2a95a681 P 913f888ae28b431bbdea058c70d688ef: Deleting consensus metadata
I20260808 07:04:38.546052 19401 tablet_replica.cc:330] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: stopping tablet replica
I20260808 07:04:38.546224 19401 raft_consensus.cc:2229] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:38.546396 19401 raft_consensus.cc:2258] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:38.546561 18629 catalog_manager.cc:4841] TS 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679): tablet 408976d82c4b445c8069cabc2a95a681 (table test-table [id=d562da98e68b4a5494f1e7ecd3c3e685]) successfully deleted
I20260808 07:04:38.546954 19401 ts_tablet_manager.cc:1905] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:38.548170 19401 ts_tablet_manager.cc:1918] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:38.548237 19401 log.cc:1196] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/408976d82c4b445c8069cabc2a95a681
I20260808 07:04:38.548465 19401 ts_tablet_manager.cc:1939] T 408976d82c4b445c8069cabc2a95a681 P 5738ec07836248daae77b8afb4d5833a: Deleting consensus metadata
I20260808 07:04:38.548916 18631 catalog_manager.cc:4841] TS 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163): tablet 408976d82c4b445c8069cabc2a95a681 (table test-table [id=d562da98e68b4a5494f1e7ecd3c3e685]) successfully deleted
W20260808 07:04:38.555717 18631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:35197 (error 108)
I20260808 07:04:38.556262 19363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:38.556115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:35197 (local address 127.0.0.1:45658)
0808 07:04:38.556178 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:38.556222 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:35197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 07:04:38.556288 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 18945
W20260808 07:04:38.558983 18631 catalog_manager.cc:4584] TS b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 408976d82c4b445c8069cabc2a95a681: Network error: Client connection negotiation failed: client connection to 127.26.23.129:35197: connect: Connection refused (error 111)
I20260808 07:04:38.563140 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 19149
I20260808 07:04:38.571516 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 18592
I20260808 07:04:58.586016 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39345
--webserver_interface=127.26.23.190
--webserver_port=34047
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:04:58.668087 19403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:58.668273 19403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:58.668293 19403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:58.669358 19403 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:04:58.669391 19403 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:04:58.669404 19403 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:04:58.669413 19403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:04:58.669425 19403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:58.669436 19403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:58.669452 19403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:04:58.669528 19403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:04:58.671116 19403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=34047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:58.671342 19403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:58.671546 19403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:58.680445 19416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:58.680536 19403 server_base.cc:1034] running on GCE node
W20260808 07:04:58.680454 19418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:58.680452 19413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:58.680987 19403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:58.681278 19403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:58.682418 19403 hybrid_clock.cc:648] HybridClock initialized: now 1786172698682399 us; error 34 us; skew 500 ppm
Aug 08 07:04:58 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:58.684856 19403 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:04:58.685320 19403 webserver.cc:460] Webserver started at http://127.26.23.190:34047/ using document root <none> and password file <none>
I20260808 07:04:58.685537 19403 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:58.685612 19403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:58.686964 19403 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:58.687529 19426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.687693 19403 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:04:58.687783 19403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "027a095bf7964d4e8ee3e0cf245aaaf3"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "3ff3d3738d9311d361db136e796a724f"
server_key_iv: "26d9e605fe8dce096ca279877044cd5a"
server_key_version: "encryptionkey@0"
I20260808 07:04:58.688162 19403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:58.699944 19403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:58.701853 19403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:58.701982 19403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:58.705994 19403 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39345
I20260808 07:04:58.706043 19499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39345 every 8 connection(s)
I20260808 07:04:58.706427 19403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:04:58.707890 19500 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:04:58.708566 19500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap starting.
I20260808 07:04:58.711902 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 19403
I20260808 07:04:58.712186 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:35197
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:39345
--webserver_port=44129
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:58.717599 19500 log.cc:824] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:58.719473 19500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:58.719732 19500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap complete.
I20260808 07:04:58.721858 19500 raft_consensus.cc:348] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:58.722088 19500 raft_consensus.cc:729] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027a095bf7964d4e8ee3e0cf245aaaf3, State: Initialized, Role: FOLLOWER
I20260808 07:04:58.722286 19500 consensus_queue.cc:260] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:58.722369 19500 raft_consensus.cc:388] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:04:58.722426 19500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:04:58.722473 19500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 1 FOLLOWER]: Advancing to term 2
I20260808 07:04:58.723634 19500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:58.723749 19500 leader_election.cc:302] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 027a095bf7964d4e8ee3e0cf245aaaf3; no voters:
I20260808 07:04:58.723913 19500 leader_election.cc:288] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 07:04:58.723960 19508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 07:04:58.724134 19508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 LEADER]: Becoming Leader. State: Replica: 027a095bf7964d4e8ee3e0cf245aaaf3, State: Running, Role: LEADER
I20260808 07:04:58.724179 19500 sys_catalog.cc:564] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:04:58.724298 19508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:04:58.724625 19509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } } }
I20260808 07:04:58.724718 19509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:58.724632 19510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 027a095bf7964d4e8ee3e0cf245aaaf3. Latest consensus state: current_term: 2 leader_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } } }
I20260808 07:04:58.724916 19510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:04:58.725153 19515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:04:58.725936 19515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:04:58.726092 19515 catalog_manager.cc:1259] Loaded cluster ID: 8e1c73ec8a44407f881f0c279eaa9801
I20260808 07:04:58.726326 19515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:04:58.727550 19515 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:04:58.727716 19515 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Loaded TSK: 0
I20260808 07:04:58.744555 19515 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Generated new TSK 1
I20260808 07:04:58.744654 19515 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:04:58.799535 19505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:58.799744 19505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:58.799767 19505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:58.800894 19505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:58.800935 19505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:58.800961 19505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:04:58.802449 19505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:35197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=44129
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:58.802661 19505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:58.802878 19505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:58.807693 19544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:58.807686 19542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:58.807864 19546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:58.808024 19505 server_base.cc:1034] running on GCE node
I20260808 07:04:58.808212 19505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:58.808422 19505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:58.809556 19505 hybrid_clock.cc:648] HybridClock initialized: now 1786172698809541 us; error 30 us; skew 500 ppm
Aug 08 07:04:58 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:58.812038 19505 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:04:58.812466 19505 webserver.cc:460] Webserver started at http://127.26.23.129:44129/ using document root <none> and password file <none>
I20260808 07:04:58.812732 19505 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:58.812801 19505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:58.814082 19505 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:58.814751 19558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.814924 19505 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.815008 19505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "b8e3605f1e31461994f7dd640757a677"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "45d1ddfec55acce98fcc27a709a87378"
server_key_iv: "3113491680aab41169fd9accae267eb6"
server_key_version: "encryptionkey@0"
I20260808 07:04:58.815330 19505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:58.847636 19505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:58.849566 19505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:58.849700 19505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:58.849900 19505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:58.850302 19569 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:04:58.851759 19505 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:04:58.851804 19505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:04:58.851837 19505 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:04:58.852480 19505 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:04:58.852514 19505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:04:58.852622 19569 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Bootstrap starting.
I20260808 07:04:58.859071 19505 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:35197
I20260808 07:04:58.859171 19727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:35197 every 8 connection(s)
I20260808 07:04:58.859460 19505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:04:58.861711 19569 log.cc:824] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:58.863919 19569 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:04:58.864193 19569 tablet_bootstrap.cc:492] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Bootstrap complete.
I20260808 07:04:58.865128 19569 ts_tablet_manager.cc:1397] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.009s
I20260808 07:04:58.866374 19569 raft_consensus.cc:348] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:58.866606 19569 raft_consensus.cc:729] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e3605f1e31461994f7dd640757a677, State: Initialized, Role: FOLLOWER
Aug 08 07:04:58 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:58.866715 19569 consensus_queue.cc:260] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:58.866967 19569 ts_tablet_manager.cc:1428] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Time spent starting tablet: real 0.002s user 0.004s sys 0.001s
I20260808 07:04:58.867848 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 19505
I20260808 07:04:58.868136 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:38679
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:39345
--webserver_port=41789
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:04:58.870585 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:58.860240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:41833 (local address 127.26.23.190:39345)
0808 07:04:58.860418 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:58.860427 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:58.860458 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:04:58.861133 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:58.861139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:58.861181 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:58.861283 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:58.862099 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.863062 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.864483 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.864867 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.864943 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:58.867210 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:58.867213 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:58.867213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:58.867223 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:58.868938 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:58.869305 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:58.869308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:58.869309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:58.869424 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:58.869640 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:58.869641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:58.869641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:58.869929 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:58.869997 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:58.870342 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 07:04:58.870447 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
I20260808 07:04:58.870656 19733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:58.860066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:41833)
0808 07:04:58.860247 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:58.860308 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:58.860936 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:58.861358 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:58.861362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:58.861719 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:58.861979 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:58.861985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.863179 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.863180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:58.864409 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:58.864412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.864945 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.864946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:58.865094 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:58.865553 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:58.865562 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:58.867113 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:58.869009 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:58.869015 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:58.869017 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:58.869230 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:58.869484 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:58.869485 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:58.869485 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:58.869586 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:58.870003 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:58.870011 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:58.870185 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 07:04:58.870297 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 07:04:58.870465 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260808 07:04:58.871311 19730 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39345
I20260808 07:04:58.871403 19730 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:58.871574 19730 heartbeater.cc:511] Master 127.26.23.190:39345 requested a full tablet report, sending...
I20260808 07:04:58.872254 19446 ts_manager.cc:194] Registered new tserver with Master: b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197)
I20260808 07:04:58.873345 19446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:41833
I20260808 07:04:58.874264 19730 heartbeater.cc:503] Master 127.26.23.190:39345 was elected leader, sending a full tablet report...
Aug 08 07:04:58 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.129@KRBTEST.COM
I20260808 07:04:58.880682 19741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:58.873068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38480 (local address 127.26.23.129:35197)
0808 07:04:58.873197 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:58.873201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:58.873210 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:04:58.873239 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:58.873240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:58.873253 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:58.873324 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:58.873801 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.874746 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.875787 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.876051 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.876099 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:58.878168 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:58.878177 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:58.878177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:58.878184 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:58.879565 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:58.879980 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:58.879982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:58.879982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:58.880031 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:58.880195 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:58.880195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:58.880195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:58.880313 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:58.880369 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:58.880525 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 07:04:58.880595 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260808 07:04:58.880728 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:58.872849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:35197 (local address 127.0.0.1:38480)
0808 07:04:58.873042 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:58.873089 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:58.873153 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:58.873334 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:58.873338 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:58.873673 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:58.873732 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:58.873735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.874823 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.874824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:58.875712 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:58.875716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.876118 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.876119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:58.876202 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:58.876605 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:58.876610 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:58.878067 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:58.879663 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:58.879670 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:58.879672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:58.879915 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:58.880081 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:58.880082 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:58.880082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:58.880146 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:58.880362 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:58.880368 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:58.880422 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 07:04:58.880500 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:04:58.880624 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":82,"threads_started":1}
I20260808 07:04:58.881228 19630 tablet_service.cc:1514] Processing DeleteTablet for tablet 408976d82c4b445c8069cabc2a95a681 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:38 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38480
I20260808 07:04:58.881803 19742 tablet_replica.cc:330] stopping tablet replica
I20260808 07:04:58.881901 19742 raft_consensus.cc:2229] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:58.881968 19742 raft_consensus.cc:2258] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:58.882297 19742 ts_tablet_manager.cc:1905] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:58.884379 19742 ts_tablet_manager.cc:1918] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:58.884445 19742 log.cc:1196] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal/wals/408976d82c4b445c8069cabc2a95a681
I20260808 07:04:58.884630 19742 ts_tablet_manager.cc:1939] T 408976d82c4b445c8069cabc2a95a681 P b8e3605f1e31461994f7dd640757a677: Deleting consensus metadata
I20260808 07:04:58.885051 19429 catalog_manager.cc:4841] TS b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197): tablet 408976d82c4b445c8069cabc2a95a681 (table test-table [id=d562da98e68b4a5494f1e7ecd3c3e685]) successfully deleted
W20260808 07:04:58.952315 19739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:58.952546 19739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:58.952591 19739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:58.953760 19739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:58.953802 19739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:58.953827 19739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:04:58.955260 19739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:38679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=41789
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:58.955439 19739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:58.955628 19739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:58.960335 19747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:58.960417 19739 server_base.cc:1034] running on GCE node
W20260808 07:04:58.960320 19754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:58.960511 19750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:58.960762 19739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:58.960987 19739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:58.962128 19739 hybrid_clock.cc:648] HybridClock initialized: now 1786172698962114 us; error 28 us; skew 500 ppm
Aug 08 07:04:58 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:58.964543 19739 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:04:58.964947 19739 webserver.cc:460] Webserver started at http://127.26.23.130:41789/ using document root <none> and password file <none>
I20260808 07:04:58.965137 19739 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:58.965199 19739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:58.966531 19739 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:58.967067 19768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.967228 19739 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.967316 19739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "913f888ae28b431bbdea058c70d688ef"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "96801d31a8ae07a336d2478f3398412b"
server_key_iv: "369e0c1f455aafe643a143fda8d273b1"
server_key_version: "encryptionkey@0"
I20260808 07:04:58.967643 19739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:58.981964 19739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:58.983639 19739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:58.983775 19739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:58.983981 19739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:58.984258 19739 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:58.984292 19739 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.984329 19739 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:58.984354 19739 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:58.989907 19739 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:38679
I20260808 07:04:58.989967 19941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:38679 every 8 connection(s)
I20260808 07:04:58.990305 19739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:04:58.994065 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 19739
I20260808 07:04:58.994403 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:45163
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:39345
--webserver_port=37409
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 07:04:58 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172698, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:58.999652 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:58.990948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:40213 (local address 127.26.23.190:39345)
0808 07:04:58.990987 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:58.990989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:58.991176 (+ 187us) server_negotiation.cc:407] Connection header received
0808 07:04:58.991694 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:58.991695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:58.991711 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:58.991767 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:58.992663 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.993185 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.994324 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.994600 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.994666 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:58.996944 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:58.996946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:58.996946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:58.996952 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:58.998335 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:58.998723 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:58.998725 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:58.998725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:58.998792 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:58.999009 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:58.999010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:58.999011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:58.999166 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:58.999237 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:58.999455 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 07:04:58.999556 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:04:58.999725 19946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:58.990910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:40213)
0808 07:04:58.991062 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:58.991096 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:58.991563 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:58.991820 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:58.991823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:58.992371 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:58.992558 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:58.992563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.993267 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.993268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:58.994200 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:58.994204 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:58.994706 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:58.994708 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:58.994843 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:58.995291 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:58.995301 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:58.996845 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:58.998418 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:58.998425 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:58.998427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:58.998651 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:58.998851 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:58.998852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:58.998852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:58.998944 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:58.999229 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:58.999234 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:58.999344 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 07:04:58.999421 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:04:58.999539 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260808 07:04:59.000204 19942 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39345
I20260808 07:04:59.000308 19942 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:59.000504 19942 heartbeater.cc:511] Master 127.26.23.190:39345 requested a full tablet report, sending...
I20260808 07:04:59.000972 19446 ts_manager.cc:194] Registered new tserver with Master: 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679)
I20260808 07:04:59.001332 19446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:40213
W20260808 07:04:59.077273 19949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:04:59.077473 19949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:04:59.077495 19949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:04:59.078632 19949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:04:59.078673 19949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:04:59.078702 19949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:04:59.080107 19949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:45163
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=37409
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:04:59.080319 19949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:04:59.080526 19949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:04:59.085440 19963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:59.085451 19958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:04:59.085469 19956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:04:59.085691 19949 server_base.cc:1034] running on GCE node
I20260808 07:04:59.085880 19949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:04:59.086095 19949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:04:59.087235 19949 hybrid_clock.cc:648] HybridClock initialized: now 1786172699087194 us; error 57 us; skew 500 ppm
Aug 08 07:04:59 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172699, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:04:59.089661 19949 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:04:59.090112 19949 webserver.cc:460] Webserver started at http://127.26.23.131:37409/ using document root <none> and password file <none>
I20260808 07:04:59.090333 19949 fs_manager.cc:359] Metadata directory not provided
I20260808 07:04:59.090399 19949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:04:59.091743 19949 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:04:59.092286 19974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:59.092425 19949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:04:59.092507 19949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "5738ec07836248daae77b8afb4d5833a"
format_stamp: "Formatted at 2026-08-08 07:04:38 on dist-test-slave-zj8q"
server_key: "a9449fe8e05c0bb659869b12d9eb71cd"
server_key_iv: "ccc9f1b65363bcd2f1f26fb1ce2b1753"
server_key_version: "encryptionkey@0"
I20260808 07:04:59.092834 19949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:04:59.115477 19949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:04:59.117347 19949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:04:59.117483 19949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:04:59.117717 19949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:04:59.118005 19949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:04:59.118038 19949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:59.118068 19949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:04:59.118093 19949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:04:59.123719 19949 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:45163
I20260808 07:04:59.123776 20142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:45163 every 8 connection(s)
I20260808 07:04:59.124114 19949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:04:59 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172699, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:04:59.131191 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 19949
I20260808 07:04:59.133679 19734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.124839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:42719 (local address 127.26.23.190:39345)
0808 07:04:59.124900 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.124902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.125093 (+ 191us) server_negotiation.cc:407] Connection header received
0808 07:04:59.125786 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.125787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.125800 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.125853 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:59.126881 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.127378 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.128348 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.128553 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.128611 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.130721 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:59.130723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:59.130723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:59.130731 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:59.132249 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:59.132705 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:59.132707 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:59.132707 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:59.132766 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:59.133054 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:59.133054 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:59.133055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:59.133156 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:59.133204 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.133521 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.133602 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:04:59.133796 20145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.124817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:42719)
0808 07:04:59.124976 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.125013 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:59.125671 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:59.125923 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:59.125927 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:59.126587 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:04:59.126780 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.126786 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.127463 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.127464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.128260 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.128262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.128624 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.128625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.128747 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.129214 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:04:59.129222 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:04:59.130638 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:04:59.132325 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:59.132333 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:59.132336 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:59.132635 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:59.132827 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:04:59.132828 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:04:59.132828 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:04:59.132967 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:04:59.133209 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:04:59.133214 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:04:59.133366 (+ 152us) client_negotiation.cc:769] Sending connection context
0808 07:04:59.133472 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 07:04:59.133614 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
I20260808 07:04:59.134305 20143 heartbeater.cc:347] Connected to a master server at 127.26.23.190:39345
I20260808 07:04:59.134394 20143 heartbeater.cc:464] Registering TS with master...
I20260808 07:04:59.134562 20143 heartbeater.cc:511] Master 127.26.23.190:39345 requested a full tablet report, sending...
I20260808 07:04:59.134935 19446 ts_manager.cc:194] Registered new tserver with Master: 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163)
I20260808 07:04:59.135389 19446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:42719
I20260808 07:04:59.138314 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.131634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34154 (local address 127.26.23.190:39345)
0808 07:04:59.131778 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.131780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.131876 (+ 96us) server_negotiation.cc:407] Connection header received
0808 07:04:59.131945 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.131946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.131958 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.132010 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:59.132735 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.133398 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.134762 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.135037 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.135096 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.136362 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:59.136363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:59.136364 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:59.136370 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:59.137433 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:59.137734 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:59.137734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:59.137735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:59.137779 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:59.137906 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:59.137911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:59.137911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:59.137998 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:59.138109 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.138137 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.138242 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260808 07:04:59.138955 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:04:59.141453 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.139249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.26.23.190:39345)
0808 07:04:59.139296 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.139298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.139397 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:04:59.139467 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.139468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.139501 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.139564 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:59.139682 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.140117 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.140817 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.141018 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.141079 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.141224 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:59.141268 (+ 44us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 07:04:59.141399 (+ 131us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34156: token expired
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 07:04:59.141505 20146 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34156: token expired
W20260808 07:04:59.141690 19351 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.26.23.190:39345)
I20260808 07:04:59.147017 20146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.141897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34158 (local address 127.26.23.190:39345)
0808 07:04:59.141936 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.141938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.141947 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:04:59.142002 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.142003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.142011 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.142065 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:04:59.142535 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.142968 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.143658 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.143842 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.143892 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.144845 (+ 953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:04:59.144846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:04:59.144846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:04:59.144852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:04:59.146009 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:59.146361 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:59.146362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:59.146362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:59.146415 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:04:59.146584 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:04:59.146585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:04:59.146585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:04:59.146683 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:04:59.146766 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.146862 (+ 96us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.146936 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:04:59.148131 19446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:04:59.149741 19446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:04:59.152021 19630 tablet_service.cc:1467] Processing CreateTablet for tablet bd446911f4ca4d65a5f373d4990bc004 (DEFAULT_TABLE table=test-table [id=659f71d3de094dbbae5e050fc45d379c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:59.152243 19630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd446911f4ca4d65a5f373d4990bc004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:59.153753 19569 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Bootstrap starting.
I20260808 07:04:59.154052 19569 tablet_bootstrap.cc:654] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:59.154922 19569 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: No bootstrap required, opened a new log
I20260808 07:04:59.154968 19569 ts_tablet_manager.cc:1397] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:59.155303 19569 raft_consensus.cc:348] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.155382 19569 raft_consensus.cc:374] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:59.155427 19569 raft_consensus.cc:729] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e3605f1e31461994f7dd640757a677, State: Initialized, Role: FOLLOWER
I20260808 07:04:59.155473 19569 consensus_queue.cc:260] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.155562 19569 ts_tablet_manager.cc:1428] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 07:04:59.155596 20151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.151584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45163 (local address 127.0.0.1:48650)
0808 07:04:59.151766 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.151777 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:59.151828 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:59.152106 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:59.152107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:59.152109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:59.152153 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.152155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.153231 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.153232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.154385 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.154388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.155331 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.155332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.155399 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.155423 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 07:04:59.155483 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 07:04:59.155528 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":122,"threads_started":1}
I20260808 07:04:59.155687 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.151543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:38679 (local address 127.0.0.1:49330)
0808 07:04:59.151588 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.151598 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:59.151636 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:59.152037 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:59.152039 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:59.152041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:59.152083 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.152085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.153448 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.153449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.154501 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.154503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.155433 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.155434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.155509 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.155514 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:04:59.155566 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:04:59.155621 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:04:59.155700 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.151638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49330 (local address 127.26.23.130:38679)
0808 07:04:59.151862 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.151867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.151877 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:04:59.151919 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.151921 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.151936 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.152016 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:59.152206 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.153367 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.154561 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.155337 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.155426 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.155479 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.155581 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.155620 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":112,"threads_started":1}
I20260808 07:04:59.156270 20153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.151804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48650 (local address 127.26.23.131:45163)
0808 07:04:59.151955 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.151959 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.151968 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:04:59.152001 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.152003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.152016 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.152221 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:59.152289 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.153160 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.154498 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.155240 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.155316 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.155376 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.156161 (+ 785us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.156205 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260808 07:04:59.156414 19841 tablet_service.cc:1467] Processing CreateTablet for tablet bd446911f4ca4d65a5f373d4990bc004 (DEFAULT_TABLE table=test-table [id=659f71d3de094dbbae5e050fc45d379c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:59.156774 19841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd446911f4ca4d65a5f373d4990bc004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:59.156842 20044 tablet_service.cc:1467] Processing CreateTablet for tablet bd446911f4ca4d65a5f373d4990bc004 (DEFAULT_TABLE table=test-table [id=659f71d3de094dbbae5e050fc45d379c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:04:59.157171 20044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd446911f4ca4d65a5f373d4990bc004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:04:59.159466 20156 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Bootstrap starting.
I20260808 07:04:59.159729 20157 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Bootstrap starting.
I20260808 07:04:59.160229 20156 tablet_bootstrap.cc:654] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:59.160288 20157 tablet_bootstrap.cc:654] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Neither blocks nor log segments found. Creating new log.
I20260808 07:04:59.160701 20156 log.cc:824] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:59.160737 20157 log.cc:824] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:04:59.161382 20156 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: No bootstrap required, opened a new log
I20260808 07:04:59.161444 20156 ts_tablet_manager.cc:1397] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:04:59.162463 20157 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: No bootstrap required, opened a new log
I20260808 07:04:59.162518 20157 ts_tablet_manager.cc:1397] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 07:04:59.162839 20156 raft_consensus.cc:348] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.162972 20156 raft_consensus.cc:374] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:59.163002 20156 raft_consensus.cc:729] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 913f888ae28b431bbdea058c70d688ef, State: Initialized, Role: FOLLOWER
I20260808 07:04:59.163141 20156 consensus_queue.cc:260] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.163434 20156 ts_tablet_manager.cc:1428] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:59.163507 19942 heartbeater.cc:503] Master 127.26.23.190:39345 was elected leader, sending a full tablet report...
I20260808 07:04:59.164206 20157 raft_consensus.cc:348] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.164376 20157 raft_consensus.cc:374] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:04:59.164419 20157 raft_consensus.cc:729] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5738ec07836248daae77b8afb4d5833a, State: Initialized, Role: FOLLOWER
I20260808 07:04:59.164530 20157 consensus_queue.cc:260] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.164769 20157 ts_tablet_manager.cc:1428] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:04:59.164798 20143 heartbeater.cc:503] Master 127.26.23.190:39345 was elected leader, sending a full tablet report...
W20260808 07:04:59.240828 19944 tablet.cc:2369] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:04:59.270133 20160 raft_consensus.cc:482] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:04:59.270309 20160 raft_consensus.cc:504] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.270707 20160 leader_election.cc:288] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163), b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197)
I20260808 07:04:59.274446 19946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.270884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45163 (local address 127.26.23.130:50191)
0808 07:04:59.270927 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.270940 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:59.270996 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:59.271217 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:59.271218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:59.271221 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:59.271295 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.271297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.272276 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.272277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.273562 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.273565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.274176 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.274177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.274263 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.274268 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:04:59.274321 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:04:59.274366 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":41}
I20260808 07:04:59.274459 20153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.270975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:50191 (local address 127.26.23.131:45163)
0808 07:04:59.271048 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.271050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.271058 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:04:59.271085 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.271086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.271095 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.271161 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:59.271373 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.272170 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.273677 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.274069 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.274135 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.274143 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.274337 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.274384 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 07:04:59.274536 19741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.271112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:58375 (local address 127.26.23.129:35197)
0808 07:04:59.271182 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.271184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.271248 (+ 64us) server_negotiation.cc:407] Connection header received
0808 07:04:59.271283 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.271285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.271311 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.271373 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:04:59.271519 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.272244 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.273718 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.274203 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.274267 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.274354 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.274429 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.274475 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 07:04:59.274560 20165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.270983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:35197 (local address 127.26.23.130:58375)
0808 07:04:59.271178 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.271187 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:04:59.271240 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:04:59.271392 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:04:59.271393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:04:59.271395 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:04:59.271442 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.271443 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.272320 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.272321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.273563 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:04:59.273565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.274286 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.274287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:04:59.274362 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.274366 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:04:59.274411 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:04:59.274450 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":6,"thread_start_us":103,"threads_started":1}
I20260808 07:04:59.274847 19662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd446911f4ca4d65a5f373d4990bc004" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8e3605f1e31461994f7dd640757a677" is_pre_election: true
I20260808 07:04:59.274886 20075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd446911f4ca4d65a5f373d4990bc004" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5738ec07836248daae77b8afb4d5833a" is_pre_election: true
I20260808 07:04:59.275022 20075 raft_consensus.cc:2454] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 0.
I20260808 07:04:59.275022 19662 raft_consensus.cc:2454] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 0.
I20260808 07:04:59.275259 19772 leader_election.cc:302] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 913f888ae28b431bbdea058c70d688ef, b8e3605f1e31461994f7dd640757a677; no voters:
I20260808 07:04:59.275393 20160 raft_consensus.cc:2781] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:04:59.275452 20160 raft_consensus.cc:482] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:04:59.275468 20160 raft_consensus.cc:3037] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:59.276176 20160 raft_consensus.cc:504] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.276283 20160 leader_election.cc:288] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 election: Requested vote from peers 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163), b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197)
I20260808 07:04:59.276439 20075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd446911f4ca4d65a5f373d4990bc004" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5738ec07836248daae77b8afb4d5833a"
I20260808 07:04:59.276513 19662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd446911f4ca4d65a5f373d4990bc004" candidate_uuid: "913f888ae28b431bbdea058c70d688ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8e3605f1e31461994f7dd640757a677"
I20260808 07:04:59.276536 20075 raft_consensus.cc:3037] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:59.276592 19662 raft_consensus.cc:3037] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:04:59.277484 19662 raft_consensus.cc:2454] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 1.
I20260808 07:04:59.277482 20075 raft_consensus.cc:2454] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 913f888ae28b431bbdea058c70d688ef in term 1.
I20260808 07:04:59.277667 19772 leader_election.cc:302] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 913f888ae28b431bbdea058c70d688ef, b8e3605f1e31461994f7dd640757a677; no voters:
I20260808 07:04:59.277751 20160 raft_consensus.cc:2781] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:04:59.277899 20160 raft_consensus.cc:686] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 1 LEADER]: Becoming Leader. State: Replica: 913f888ae28b431bbdea058c70d688ef, State: Running, Role: LEADER
I20260808 07:04:59.277977 20160 consensus_queue.cc:237] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:04:59.278863 19446 catalog_manager.cc:5495] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 913f888ae28b431bbdea058c70d688ef (127.26.23.130). New cstate: current_term: 1 leader_uuid: "913f888ae28b431bbdea058c70d688ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } health_report { overall_health: UNKNOWN } } }
I20260808 07:04:59.298826 20152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.296769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49338 (local address 127.26.23.130:38679)
0808 07:04:59.296817 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:04:59.296819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:04:59.296828 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:04:59.296859 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:04:59.296860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:04:59.296876 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:04:59.296929 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:04:59.297023 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.297499 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.298195 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:04:59.298387 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:04:59.298441 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:04:59.298547 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:04:59.298654 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:04:59.298712 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:04:59.298732 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 07:04:59.298750 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:04:59.300539 19662 raft_consensus.cc:1261] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Refusing update from remote peer 913f888ae28b431bbdea058c70d688ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:59.300539 20075 raft_consensus.cc:1261] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Refusing update from remote peer 913f888ae28b431bbdea058c70d688ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:04:59.300901 20160 consensus_queue.cc:1035] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:59.301048 20166 consensus_queue.cc:1035] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:04:59.305298 19444 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:59.305385 19444 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:04:59.306186 19444 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Sending DeleteTablet for 3 replicas of tablet bd446911f4ca4d65a5f373d4990bc004
I20260808 07:04:59.306509 19630 tablet_service.cc:1514] Processing DeleteTablet for tablet bd446911f4ca4d65a5f373d4990bc004 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:59 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38480
I20260808 07:04:59.306537 20044 tablet_service.cc:1514] Processing DeleteTablet for tablet bd446911f4ca4d65a5f373d4990bc004 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:59 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:48650
I20260808 07:04:59.306607 19742 tablet_replica.cc:330] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: stopping tablet replica
I20260808 07:04:59.306653 19742 raft_consensus.cc:2229] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:59.306706 19742 raft_consensus.cc:2258] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:59.306775 19841 tablet_service.cc:1514] Processing DeleteTablet for tablet bd446911f4ca4d65a5f373d4990bc004 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:04:59 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:49330
I20260808 07:04:59.307062 20180 tablet_replica.cc:330] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: stopping tablet replica
I20260808 07:04:59.307058 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 19505
I20260808 07:04:59.307153 19742 ts_tablet_manager.cc:1905] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:59.314044 20180 raft_consensus.cc:2229] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:04:59.314256 20180 raft_consensus.cc:2258] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:59.315153 20180 ts_tablet_manager.cc:1905] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:04:59.316785 20180 ts_tablet_manager.cc:1918] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:04:59.316850 20180 log.cc:1196] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/bd446911f4ca4d65a5f373d4990bc004
I20260808 07:04:59.317152 20180 ts_tablet_manager.cc:1939] T bd446911f4ca4d65a5f373d4990bc004 P 5738ec07836248daae77b8afb4d5833a: Deleting consensus metadata
I20260808 07:04:59.317741 19429 catalog_manager.cc:4841] TS 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163): tablet bd446911f4ca4d65a5f373d4990bc004 (table test-table [id=659f71d3de094dbbae5e050fc45d379c]) successfully deleted
I20260808 07:04:59.322453 20181 tablet_replica.cc:330] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: stopping tablet replica
I20260808 07:04:59.322589 20181 raft_consensus.cc:2229] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:04:59.322712 20181 raft_consensus.cc:2258] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:04:59.323153 20181 ts_tablet_manager.cc:1905] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 07:04:59.323762 19429 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:35197 (error 108)
I20260808 07:04:59.324120 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 19739
I20260808 07:04:59.324363 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.324235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:35197 (local address 127.0.0.1:38494)
0808 07:04:59.324280 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.324327 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:35197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:04:59.324466 19429 catalog_manager.cc:4584] TS b8e3605f1e31461994f7dd640757a677 (127.26.23.129:35197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd446911f4ca4d65a5f373d4990bc004: Network error: Client connection negotiation failed: client connection to 127.26.23.129:35197: connect: Connection refused (error 111)
I20260808 07:04:59.333968 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 19949
I20260808 07:04:59.333984 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:04:59.333871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:38679 (local address 127.0.0.1:49344)
0808 07:04:59.333924 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:04:59.333953 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.130:38679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:04:59.346047 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 19403
I20260808 07:05:19.355803 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39345
--webserver_interface=127.26.23.190
--webserver_port=34047
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:39345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.436842 20183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.437037 20183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.437067 20183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.438262 20183 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 07:05:19.438300 20183 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 07:05:19.438318 20183 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 07:05:19.438333 20183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:19.438359 20183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.438385 20183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.438403 20183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:19.438426 20183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:19.439863 20183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:39345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:39345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=34047
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:19.440099 20183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.440299 20183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.445159 20189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.445169 20183 server_base.cc:1034] running on GCE node
W20260808 07:05:19.445179 20198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.445235 20190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.445660 20183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.445896 20183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.447028 20183 hybrid_clock.cc:648] HybridClock initialized: now 1786172719447004 us; error 42 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.449369 20183 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:05:19.449796 20183 webserver.cc:460] Webserver started at http://127.26.23.190:34047/ using document root <none> and password file <none>
I20260808 07:05:19.449996 20183 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.450042 20183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.451290 20183 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.451916 20209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.452085 20183 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:19.452171 20183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "027a095bf7964d4e8ee3e0cf245aaaf3"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "3ff3d3738d9311d361db136e796a724f"
server_key_iv: "26d9e605fe8dce096ca279877044cd5a"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.452461 20183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.475486 20183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.477150 20183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.477257 20183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.480960 20183 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:39345
I20260808 07:05:19.481007 20289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:39345 every 8 connection(s)
I20260808 07:05:19.481336 20183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:19.482762 20291 sys_catalog.cc:263] Verifying existing consensus state
I20260808 07:05:19.483409 20291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap starting.
I20260808 07:05:19.491449 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 20183
I20260808 07:05:19.491794 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:35197
--local_ip_for_outbound_sockets=127.26.23.129
--tserver_master_addrs=127.26.23.190:39345
--webserver_port=44129
--webserver_interface=127.26.23.129
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:05:19.492424 20291 log.cc:824] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:19.494764 20291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:05:19.495034 20291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Bootstrap complete.
I20260808 07:05:19.497128 20291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:05:19.497342 20291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 027a095bf7964d4e8ee3e0cf245aaaf3, State: Initialized, Role: FOLLOWER
I20260808 07:05:19.497478 20291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:05:19.497536 20291 raft_consensus.cc:388] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:19.497575 20291 raft_consensus.cc:482] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:19.497623 20291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 2 FOLLOWER]: Advancing to term 3
I20260808 07:05:19.498607 20291 raft_consensus.cc:504] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:05:19.498697 20291 leader_election.cc:302] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 027a095bf7964d4e8ee3e0cf245aaaf3; no voters:
I20260808 07:05:19.498845 20291 leader_election.cc:288] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 07:05:19.498896 20295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 07:05:19.499061 20295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [term 3 LEADER]: Becoming Leader. State: Replica: 027a095bf7964d4e8ee3e0cf245aaaf3, State: Running, Role: LEADER
I20260808 07:05:19.499104 20291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:19.499179 20295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } }
I20260808 07:05:19.499451 20295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 027a095bf7964d4e8ee3e0cf245aaaf3. Latest consensus state: current_term: 3 leader_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } } }
I20260808 07:05:19.499617 20298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "027a095bf7964d4e8ee3e0cf245aaaf3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 39345 } } }
I20260808 07:05:19.499696 20295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:19.499945 20298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:19.500200 20313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:19.500993 20313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:19.501151 20313 catalog_manager.cc:1259] Loaded cluster ID: 8e1c73ec8a44407f881f0c279eaa9801
I20260808 07:05:19.501346 20313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:19.502496 20313 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:19.502667 20313 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Loaded TSK: 0
I20260808 07:05:19.502707 20313 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 027a095bf7964d4e8ee3e0cf245aaaf3: Loaded TSK: 1
F20260808 07:05:19.502918 20313 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f54a013a9ad google::LogMessage::Fail() at ??:0
@ 0x7f54a013d88a google::LogMessage::SendToLog() at ??:0
@ 0x7f54a013a4de google::LogMessage::Flush() at ??:0
@ 0x7f54a013ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f54a28a7104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f54a28a4d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f54a80941cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f54a809448e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f54a8094594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f54a805ac48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f54a8064ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f54a20080d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f54a1ffd954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f54a2e616db start_thread at ??:0
@ 0x7f549ec3861f clone at ??:0
W20260808 07:05:19.601764 20294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.602041 20294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.602079 20294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.603751 20294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.603822 20294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.603861 20294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:19.606096 20294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:35197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=44129
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:19.606407 20294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.606665 20294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.612017 20366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.612035 20367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.612246 20294 server_base.cc:1034] running on GCE node
W20260808 07:05:19.612035 20369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.612577 20294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.612813 20294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.613957 20294 hybrid_clock.cc:648] HybridClock initialized: now 1786172719613944 us; error 32 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.616669 20294 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:05:19.617219 20294 webserver.cc:460] Webserver started at http://127.26.23.129:44129/ using document root <none> and password file <none>
I20260808 07:05:19.617496 20294 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.617568 20294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.619351 20294 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.620235 20379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.620425 20294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.620529 20294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "b8e3605f1e31461994f7dd640757a677"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "45d1ddfec55acce98fcc27a709a87378"
server_key_iv: "3113491680aab41169fd9accae267eb6"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.620970 20294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.638801 20294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.640815 20294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.640933 20294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.641165 20294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:19.641599 20388 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 07:05:19.643591 20294 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 07:05:19.643644 20294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 07:05:19.643677 20294 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 07:05:19.644311 20294 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 07:05:19.644346 20294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 07:05:19.644433 20388 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Bootstrap starting.
I20260808 07:05:19.646345 20388 log.cc:824] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:19.649353 20388 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 07:05:19.649658 20388 tablet_bootstrap.cc:492] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Bootstrap complete.
I20260808 07:05:19.649817 20388 ts_tablet_manager.cc:1397] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.005s
I20260808 07:05:19.651031 20294 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:35197
I20260808 07:05:19.651077 20554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:35197 every 8 connection(s)
I20260808 07:05:19.651402 20294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:19.651669 20388 raft_consensus.cc:348] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:05:19.652276 20388 raft_consensus.cc:729] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8e3605f1e31461994f7dd640757a677, State: Initialized, Role: FOLLOWER
I20260808 07:05:19.652405 20388 consensus_queue.cc:260] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:05:19.652621 20388 ts_tablet_manager.cc:1428] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 07:05:19.657752 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 20294
I20260808 07:05:19.657990 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:38679
--local_ip_for_outbound_sockets=127.26.23.130
--tserver_master_addrs=127.26.23.190:39345
--webserver_port=41789
--webserver_interface=127.26.23.130
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.734557 20558 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:05:19.652036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:36265)
0808 07:05:19.652201 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.652246 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:19.652411 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:19.734336 (+ 81925us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
W20260808 07:05:19.734808 20555 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:39345 (0 consecutive failures): Network error: Failed to ping master at 127.26.23.190:39345: Client connection negotiation failed: client connection to 127.26.23.190:39345: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 07:05:19.735203 20558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.735050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:56009)
0808 07:05:19.735127 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.735175 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 07:05:19.735548 20558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.735469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:43711)
0808 07:05:19.735506 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.735530 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:05:19.735663 20555 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 07:05:19.756291 20562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.756486 20562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.756520 20562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.757628 20562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.757668 20562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.757702 20562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:19.759161 20562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:38679
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=41789
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:19.759387 20562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.759593 20562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.764560 20576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.764528 20569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.764616 20562 server_base.cc:1034] running on GCE node
W20260808 07:05:19.764536 20572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.764963 20562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.765206 20562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.766345 20562 hybrid_clock.cc:648] HybridClock initialized: now 1786172719766324 us; error 32 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.768639 20562 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:05:19.769027 20562 webserver.cc:460] Webserver started at http://127.26.23.130:41789/ using document root <none> and password file <none>
I20260808 07:05:19.769236 20562 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.769289 20562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.772269 20562 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:19.772993 20588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.773168 20562 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:19.773254 20562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "913f888ae28b431bbdea058c70d688ef"
format_stamp: "Formatted at 2026-08-08 07:04:37 on dist-test-slave-zj8q"
server_key: "96801d31a8ae07a336d2478f3398412b"
server_key_iv: "369e0c1f455aafe643a143fda8d273b1"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.773584 20562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.783963 20562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.785742 20562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.785876 20562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.786096 20562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:19.786566 20598 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260808 07:05:19.789639 20598 ts_tablet_manager.cc:1852] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 07:05:19.789908 20598 ts_tablet_manager.cc:1905] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:19.792037 20598 ts_tablet_manager.cc:1918] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:19.792128 20598 log.cc:1196] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/bd446911f4ca4d65a5f373d4990bc004
I20260808 07:05:19.792366 20598 ts_tablet_manager.cc:1939] T bd446911f4ca4d65a5f373d4990bc004 P 913f888ae28b431bbdea058c70d688ef: Deleting consensus metadata
I20260808 07:05:19.792568 20562 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 07:05:19.792619 20562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 07:05:19.792654 20562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:19.792671 20562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.798431 20562 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:38679
I20260808 07:05:19.798502 20779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:38679 every 8 connection(s)
I20260808 07:05:19.798774 20562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:19.799747 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.799380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:37265)
0808 07:05:19.799537 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.799609 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
W20260808 07:05:19.799924 20780 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:39345 (0 consecutive failures): Network error: Failed to ping master at 127.26.23.190:39345: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
I20260808 07:05:19.800170 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.800079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:47533)
0808 07:05:19.800128 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.800153 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:05:19.800375 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.800320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:59481)
0808 07:05:19.800347 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.800365 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260808 07:05:19.800483 20780 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:05:19.804541 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 20562
I20260808 07:05:19.804764 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:45163
--local_ip_for_outbound_sockets=127.26.23.131
--tserver_master_addrs=127.26.23.190:39345
--webserver_port=37409
--webserver_interface=127.26.23.131
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:19.887382 20783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:19.887573 20783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:19.887603 20783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:19.888674 20783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:19.888708 20783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:19.888731 20783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:19.890122 20783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:45163
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=37409
--tserver_master_addrs=127.26.23.190:39345
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:19.890342 20783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:19.890527 20783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:19.895370 20789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.895396 20783 server_base.cc:1034] running on GCE node
W20260808 07:05:19.895370 20794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:19.895398 20792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:19.895823 20783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:19.896126 20783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:19.897292 20783 hybrid_clock.cc:648] HybridClock initialized: now 1786172719897274 us; error 33 us; skew 500 ppm
Aug 08 07:05:19 dist-test-slave-zj8q krb5kdc[18570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:19.899834 20783 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:05:19.900261 20783 webserver.cc:460] Webserver started at http://127.26.23.131:37409/ using document root <none> and password file <none>
I20260808 07:05:19.900471 20783 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:19.900516 20783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:19.901769 20783 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:19.902434 20805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.902571 20783 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:19.902654 20783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "5738ec07836248daae77b8afb4d5833a"
format_stamp: "Formatted at 2026-08-08 07:04:38 on dist-test-slave-zj8q"
server_key: "a9449fe8e05c0bb659869b12d9eb71cd"
server_key_iv: "ccc9f1b65363bcd2f1f26fb1ce2b1753"
server_key_version: "encryptionkey@0"
I20260808 07:05:19.902954 20783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:19.931829 20783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:19.933601 20783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:19.933729 20783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:19.933955 20783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:19.934302 20783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:19.934340 20783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.934369 20783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:19.934391 20783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:19.939978 20783 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:45163
I20260808 07:05:19.940032 20990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:45163 every 8 connection(s)
I20260808 07:05:19.940405 20783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:19.941399 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.941042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:52561)
0808 07:05:19.941194 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.941263 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
W20260808 07:05:19.941787 20991 heartbeater.cc:644] Failed to heartbeat to 127.26.23.190:39345 (0 consecutive failures): Network error: Failed to ping master at 127.26.23.190:39345: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
I20260808 07:05:19.942039 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.941945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:49123)
0808 07:05:19.941986 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.942015 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:05:19.942281 20994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:19.942223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:47985)
0808 07:05:19.942246 (+ 23us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:19.942266 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260808 07:05:19.942370 20991 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 07:05:19.950521 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 20783
I20260808 07:05:20.736227 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:20.735989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:58303)
0808 07:05:20.736122 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:20.736159 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260808 07:05:20.800966 20999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:20.800772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:60997)
0808 07:05:20.800889 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:20.800928 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":56,"threads_started":1}
I20260808 07:05:20.942835 21000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:20.942642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:36647)
0808 07:05:20.942747 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:20.942781 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":56,"threads_started":1}
I20260808 07:05:21.042824 21003 raft_consensus.cc:482] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:21.042966 21003 raft_consensus.cc:504] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:05:21.043319 21003 leader_election.cc:288] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679), 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163)
Aug 08 07:05:21 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.131@KRBTEST.COM
Aug 08 07:05:21 dist-test-slave-zj8q krb5kdc[18570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172719, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.130@KRBTEST.COM
I20260808 07:05:21.056360 21006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.043630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:45109 (local address 127.26.23.130:38679)
0808 07:05:21.043776 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.043790 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.043814 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:05:21.044341 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.044344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.044382 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.044519 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.045228 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.046145 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.047231 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.047622 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.047722 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.053162 (+ 5440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.053166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.053166 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.053179 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.054964 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055309 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.055313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.055313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.055412 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055598 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.055599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.055599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.055820 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.055900 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.056116 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.056237 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
I20260808 07:05:21.056363 21004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.043457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:45163 (local address 127.26.23.129:36143)
0808 07:05:21.043574 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.043585 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:21.043642 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:21.044526 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:21.044529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:21.045123 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:21.045192 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.045195 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.046359 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.046360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.047139 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.047141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.047710 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.047711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.047839 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.051067 (+ 3228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:21.051076 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:21.052516 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:21.054813 (+ 2297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.054820 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.054822 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.055027 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.055281 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055282 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.055282 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.055422 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.055821 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:21.055828 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:21.055957 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:05:21.056046 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:05:21.056231 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":26,"thread_start_us":67,"threads_started":1}
I20260808 07:05:21.056368 21009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.043619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36143 (local address 127.26.23.131:45163)
0808 07:05:21.043806 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:21.043815 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:21.043844 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:05:21.044283 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:21.044286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:21.044328 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:21.044436 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:21.045297 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.046271 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.047226 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.047627 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.047722 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.052619 (+ 4897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:21.052622 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:21.052623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:21.052634 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:21.054735 (+ 2101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055093 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.055096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.055097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.055210 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055480 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:21.055481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:21.055481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:21.055756 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:21.055817 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:21.056114 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 07:05:21.056251 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":76,"threads_started":1}
I20260808 07:05:21.056434 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.043444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:38679 (local address 127.26.23.129:45109)
0808 07:05:21.043497 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.043507 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:21.043562 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:21.044531 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:21.044532 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:21.044887 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:21.045084 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.045090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.046267 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.046268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.047145 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:21.047148 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:21.047706 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:21.047707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:21.047839 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:21.051082 (+ 3243us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:21.051086 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:21.052897 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:21.055031 (+ 2134us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055032 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.055032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.055231 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.055482 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:21.055482 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:21.055483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:21.055543 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:21.055893 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:21.055893 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:21.055956 (+ 63us) client_negotiation.cc:769] Sending connection context
0808 07:05:21.056044 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 07:05:21.056309 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":162}
W20260808 07:05:21.057246 20381 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
W20260808 07:05:21.057701 20380 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
I20260808 07:05:21.057745 20380 leader_election.cc:302] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8e3605f1e31461994f7dd640757a677; no voters: 5738ec07836248daae77b8afb4d5833a, 913f888ae28b431bbdea058c70d688ef
I20260808 07:05:21.057845 21003 raft_consensus.cc:2726] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:21.736979 21010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.736732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:35381)
0808 07:05:21.736886 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.736930 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":69,"threads_started":1}
I20260808 07:05:21.801651 21012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.801428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:52115)
0808 07:05:21.801543 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.801611 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260808 07:05:21.943498 21017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:21.943277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:59123)
0808 07:05:21.943411 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:21.943452 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260808 07:05:22.737709 21018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:22.737449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:41795)
0808 07:05:22.737588 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:22.737657 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260808 07:05:22.802354 21020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:22.802098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:46507)
0808 07:05:22.802265 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:22.802309 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260808 07:05:22.851485 21022 raft_consensus.cc:482] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:22.851622 21022 raft_consensus.cc:504] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:05:22.851781 21022 leader_election.cc:288] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679), 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163)
W20260808 07:05:22.852252 20380 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
W20260808 07:05:22.852353 20381 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
I20260808 07:05:22.852402 20381 leader_election.cc:302] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8e3605f1e31461994f7dd640757a677; no voters: 5738ec07836248daae77b8afb4d5833a, 913f888ae28b431bbdea058c70d688ef
I20260808 07:05:22.852473 21022 raft_consensus.cc:2726] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:22.944252 21023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:22.943993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:43789)
0808 07:05:22.944159 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:22.944203 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260808 07:05:23.738452 21024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.738244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:57987)
0808 07:05:23.738364 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.738402 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260808 07:05:23.802968 21025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.802767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:58149)
0808 07:05:23.802889 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.802927 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260808 07:05:23.944916 21026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:23.944717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:47063)
0808 07:05:23.944835 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:23.944871 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260808 07:05:24.739149 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.738937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:39007)
0808 07:05:24.739063 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.739093 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260808 07:05:24.803579 21028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.803392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:42337)
0808 07:05:24.803504 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.803538 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260808 07:05:24.945613 21029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:24.945354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:43459)
0808 07:05:24.945507 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:24.945566 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":64,"threads_started":1}
I20260808 07:05:25.255935 21030 raft_consensus.cc:482] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:25.256037 21030 raft_consensus.cc:504] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:05:25.256217 21030 leader_election.cc:288] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679), 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163)
W20260808 07:05:25.256588 20380 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
W20260808 07:05:25.256695 20381 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
I20260808 07:05:25.256760 20381 leader_election.cc:302] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8e3605f1e31461994f7dd640757a677; no voters: 5738ec07836248daae77b8afb4d5833a, 913f888ae28b431bbdea058c70d688ef
I20260808 07:05:25.256842 21030 raft_consensus.cc:2726] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:25.739841 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.739623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:39461)
0808 07:05:25.739754 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.739793 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260808 07:05:25.804180 21034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.803972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:57889)
0808 07:05:25.804101 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.804140 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":58,"threads_started":1}
I20260808 07:05:25.946326 21035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:25.946095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:33137)
0808 07:05:25.946240 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:25.946280 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":78,"threads_started":1}
I20260808 07:05:26.740494 21036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:26.740267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:46041)
0808 07:05:26.740405 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:26.740443 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":63,"threads_started":1}
I20260808 07:05:26.804824 21038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:26.804582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:36131)
0808 07:05:26.804743 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:26.804780 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260808 07:05:26.946933 21039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:26.946714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:60333)
0808 07:05:26.946851 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:26.946886 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260808 07:05:27.741201 21042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.740936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:48335)
0808 07:05:27.741110 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:27.741152 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":64,"threads_started":1}
I20260808 07:05:27.807408 21043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.806862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:33995)
0808 07:05:27.807310 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:27.807348 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":57,"threads_started":1}
I20260808 07:05:27.888087 21044 raft_consensus.cc:482] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:27.888185 21044 raft_consensus.cc:504] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "913f888ae28b431bbdea058c70d688ef" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38679 } } peers { permanent_uuid: "5738ec07836248daae77b8afb4d5833a" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 45163 } } peers { permanent_uuid: "b8e3605f1e31461994f7dd640757a677" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 35197 } }
I20260808 07:05:27.888334 21044 leader_election.cc:288] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679), 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163)
W20260808 07:05:27.888765 20381 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5738ec07836248daae77b8afb4d5833a (127.26.23.131:45163): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
W20260808 07:05:27.888859 20380 leader_election.cc:341] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 913f888ae28b431bbdea058c70d688ef (127.26.23.130:38679): Not found: Tablet not found: bd446911f4ca4d65a5f373d4990bc004
I20260808 07:05:27.888926 20380 leader_election.cc:302] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8e3605f1e31461994f7dd640757a677; no voters: 5738ec07836248daae77b8afb4d5833a, 913f888ae28b431bbdea058c70d688ef
I20260808 07:05:27.889016 21044 raft_consensus.cc:2726] T bd446911f4ca4d65a5f373d4990bc004 P b8e3605f1e31461994f7dd640757a677 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 07:05:27.947547 21045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:27.947337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:45725)
0808 07:05:27.947453 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:27.947485 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260808 07:05:28.741842 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:28.741633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:45713)
0808 07:05:28.741755 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:28.741791 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260808 07:05:28.808076 21049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:28.807882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:53831)
0808 07:05:28.807995 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:28.808030 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260808 07:05:28.948241 21050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:28.947980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:45379)
0808 07:05:28.948157 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:28.948195 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260808 07:05:29.742543 21051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.742300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:40929)
0808 07:05:29.742454 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:29.742493 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260808 07:05:29.808677 21053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.808492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:50103)
0808 07:05:29.808602 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:29.808636 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":62,"threads_started":1}
I20260808 07:05:29.948971 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:29.948773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:43613)
0808 07:05:29.948889 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:29.948920 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260808 07:05:30.743221 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.742991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:51375)
0808 07:05:30.743134 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.743172 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260808 07:05:30.809262 21058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.809063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:40847)
0808 07:05:30.809180 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.809215 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260808 07:05:30.949633 21060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:30.949427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:49709)
0808 07:05:30.949540 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:30.949575 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":63,"threads_started":1}
I20260808 07:05:31.743885 21061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:31.743663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:34183)
0808 07:05:31.743798 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:31.743833 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260808 07:05:31.809999 21062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:31.809760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:37863)
0808 07:05:31.809901 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:31.809954 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":63,"threads_started":1}
I20260808 07:05:31.950271 21066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:31.950000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:52351)
0808 07:05:31.950190 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:31.950226 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":92,"threads_started":1}
I20260808 07:05:32.744536 21067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.744296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:32867)
0808 07:05:32.744439 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.744477 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":63,"threads_started":1}
I20260808 07:05:32.810645 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.810424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:45173)
0808 07:05:32.810560 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.810599 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":63,"threads_started":1}
I20260808 07:05:32.950867 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:32.950661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:53055)
0808 07:05:32.950784 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:32.950820 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260808 07:05:33.745390 21073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:33.745121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:55625)
0808 07:05:33.745279 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:33.745339 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":72,"threads_started":1}
I20260808 07:05:33.811360 21075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:33.811111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:60535)
0808 07:05:33.811259 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:33.811314 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":67,"threads_started":1}
I20260808 07:05:33.951573 21076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:33.951324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:49425)
0808 07:05:33.951476 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:33.951523 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
I20260808 07:05:34.746215 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.745948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.129:37449)
0808 07:05:34.746084 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.746145 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260808 07:05:34.811985 21081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.811805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.130:55717)
0808 07:05:34.811911 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.811942 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":61,"threads_started":1}
I20260808 07:05:34.952277 21083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:34.952052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:39345 (local address 127.26.23.131:44087)
0808 07:05:34.952186 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:34.952227 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.190:39345: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":64,"threads_started":1}
I20260808 07:05:34.955363 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 20294
I20260808 07:05:34.965739 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 20562
I20260808 07:05:34.973757 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 20783
2026-08-08T07:05:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58848 ms)
[----------] 30 tests from SecurityITest (231622 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:35 dist-test-slave-zj8q krb5kdc[21087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:35 dist-test-slave-zj8q krb5kdc[21087](info): set up 2 sockets
Aug 08 07:05:35 dist-test-slave-zj8q krb5kdc[21087](info): commencing operation
krb5kdc: starting...
W20260808 07:05:36.117883 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:05:36.232327 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46447
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:46447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:36.313512 21109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:36.313723 21109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:36.313745 21109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:36.314898 21109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:36.314941 21109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:36.314953 21109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:36.314965 21109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:36.314975 21109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:36.316443 21109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:46447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:36.316677 21109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:36.316902 21109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:05:36.321797 21109 server_base.cc:1034] running on GCE node
W20260808 07:05:36.321931 21117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.321960 21121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.321990 21118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:36.322343 21109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:36.322620 21109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:36.323771 21109 hybrid_clock.cc:648] HybridClock initialized: now 1786172736323754 us; error 33 us; skew 500 ppm
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:36.326256 21109 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:05:36.326712 21109 webserver.cc:460] Webserver started at http://127.26.23.190:39187/ using document root <none> and password file <none>
I20260808 07:05:36.326910 21109 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:36.326952 21109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:36.327088 21109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:36.328157 21109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "bdbf38bb2b01413a826ac376ad62118a"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "2c6bc2b40eb06d5be094d8e4abb4897f"
server_key_iv: "4c6b49fc565a8d5a93f6e8666bbc7a27"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.328487 21109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "bdbf38bb2b01413a826ac376ad62118a"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "2c6bc2b40eb06d5be094d8e4abb4897f"
server_key_iv: "4c6b49fc565a8d5a93f6e8666bbc7a27"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.329748 21109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:36.330508 21132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.330673 21109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.330762 21109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "bdbf38bb2b01413a826ac376ad62118a"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "2c6bc2b40eb06d5be094d8e4abb4897f"
server_key_iv: "4c6b49fc565a8d5a93f6e8666bbc7a27"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.330817 21109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:36.342618 21109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:36.344292 21109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:36.344398 21109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:36.348044 21109 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:46447
I20260808 07:05:36.348084 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:46447 every 8 connection(s)
I20260808 07:05:36.348378 21109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:36.349169 21217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:36.351507 21217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a: Bootstrap starting.
I20260808 07:05:36.352088 21217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:36.352349 21217 log.cc:824] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:36.353047 21217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a: No bootstrap required, opened a new log
I20260808 07:05:36.354759 21217 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf38bb2b01413a826ac376ad62118a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46447 } }
I20260808 07:05:36.354902 21217 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:36.354924 21217 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbf38bb2b01413a826ac376ad62118a, State: Initialized, Role: FOLLOWER
I20260808 07:05:36.355067 21217 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf38bb2b01413a826ac376ad62118a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46447 } }
I20260808 07:05:36.355132 21217 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:36.355152 21217 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:36.355201 21217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:36.355711 21217 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf38bb2b01413a826ac376ad62118a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46447 } }
I20260808 07:05:36.355806 21217 leader_election.cc:302] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdbf38bb2b01413a826ac376ad62118a; no voters:
I20260808 07:05:36.355978 21217 leader_election.cc:288] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:36.356012 21222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:36.356151 21222 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [term 1 LEADER]: Becoming Leader. State: Replica: bdbf38bb2b01413a826ac376ad62118a, State: Running, Role: LEADER
I20260808 07:05:36.356231 21217 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:36.356241 21222 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf38bb2b01413a826ac376ad62118a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46447 } }
I20260808 07:05:36.356618 21224 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdbf38bb2b01413a826ac376ad62118a. Latest consensus state: current_term: 1 leader_uuid: "bdbf38bb2b01413a826ac376ad62118a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf38bb2b01413a826ac376ad62118a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46447 } } }
I20260808 07:05:36.356771 21224 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:36.356771 21223 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdbf38bb2b01413a826ac376ad62118a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf38bb2b01413a826ac376ad62118a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46447 } } }
I20260808 07:05:36.356922 21223 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:36.357015 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 21109
I20260808 07:05:36.357115 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:36.357270 26718 external_mini_cluster.cc:1428] Setting key 0641e89e249a4771cabef2ce819ea355
I20260808 07:05:36.358310 21232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:36.358834 21232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:36.360250 21232 catalog_manager.cc:1347] Generated new cluster ID: f4d0cf5973804d8d9087d28e1f6d3888
I20260808 07:05:36.360297 21232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:36.368824 21239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.357839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57486 (local address 127.26.23.190:46447)
0808 07:05:36.358001 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.358011 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.358345 (+ 334us) server_negotiation.cc:407] Connection header received
0808 07:05:36.358473 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.358480 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.358548 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.358704 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:36.359438 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.360878 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.361920 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.362590 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.362704 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.365391 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:36.365395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:36.365396 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:36.365407 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:36.367250 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.367657 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.367659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.367660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.367768 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.367963 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.367963 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.367964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.368246 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:36.368377 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.368495 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.368619 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":78,"threads_started":1}
I20260808 07:05:36.371368 21232 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:36.371829 21232 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:36.380733 21232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a: Generated new TSK 0
I20260808 07:05:36.380888 21232 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:05:36.408362 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:46447
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:36.488914 21257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:36.489110 21257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:36.489141 21257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:36.490274 21257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:36.490314 21257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:36.490348 21257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:36.491760 21257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:36.491981 21257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:36.492187 21257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:36.497073 21270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.497082 21267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.497082 21266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:36.497334 21257 server_base.cc:1034] running on GCE node
I20260808 07:05:36.497512 21257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:36.497750 21257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:36.498889 21257 hybrid_clock.cc:648] HybridClock initialized: now 1786172736498878 us; error 26 us; skew 500 ppm
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:36.501291 21257 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:05:36.501669 21257 webserver.cc:460] Webserver started at http://127.26.23.129:32965/ using document root <none> and password file <none>
I20260808 07:05:36.501835 21257 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:36.501874 21257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:36.501964 21257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:36.502957 21257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "4e786468c5b9462e98c10e837f4e6b5d"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "3574edcb046a3fed65651a90fedba2fe"
server_key_iv: "874dad9890455c09985f183c0d7697f9"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.503255 21257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "4e786468c5b9462e98c10e837f4e6b5d"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "3574edcb046a3fed65651a90fedba2fe"
server_key_iv: "874dad9890455c09985f183c0d7697f9"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.504475 21257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:36.505138 21281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.505278 21257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:36.505362 21257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "4e786468c5b9462e98c10e837f4e6b5d"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "3574edcb046a3fed65651a90fedba2fe"
server_key_iv: "874dad9890455c09985f183c0d7697f9"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.505414 21257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:36.532230 21257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:36.534324 21257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:36.534441 21257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:36.534685 21257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:36.534960 21257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:36.534989 21257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.535010 21257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:36.535025 21257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.540395 21257 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:36395
I20260808 07:05:36.540453 21447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:36395 every 8 connection(s)
I20260808 07:05:36.540740 21257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:36.543859 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 21257
I20260808 07:05:36.543936 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:36.544142 26718 external_mini_cluster.cc:1428] Setting key 1f5ec7e12e4015c74f4f30bad4f188d4
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:36.549854 21239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.541414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:52475 (local address 127.26.23.190:46447)
0808 07:05:36.541485 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.541488 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.541658 (+ 170us) server_negotiation.cc:407] Connection header received
0808 07:05:36.542183 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.542184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.542195 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.542251 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:36.543139 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.543637 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.544769 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.545061 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.545167 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.547314 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:36.547316 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:36.547316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:36.547324 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:36.548548 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.548969 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.548971 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.548971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.549030 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.549246 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.549247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.549247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.549359 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:36.549415 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.549674 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.549765 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:05:36.549997 21451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.541366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:46447 (local address 127.26.23.129:52475)
0808 07:05:36.541527 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.541565 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.542049 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.542310 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.542314 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.542861 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:36.543045 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.543050 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.543723 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.543724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.544695 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.544699 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.545180 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.545180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.545282 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.545779 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:36.545788 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:36.547228 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:36.548630 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:36.548637 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:36.548639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:36.548902 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:36.549084 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:36.549085 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:36.549086 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:36.549190 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:36.549413 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:36.549420 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:36.549551 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.549641 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.549793 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":69,"threads_started":1}
I20260808 07:05:36.550495 21448 heartbeater.cc:347] Connected to a master server at 127.26.23.190:46447
I20260808 07:05:36.550612 21448 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:36.550808 21448 heartbeater.cc:511] Master 127.26.23.190:46447 requested a full tablet report, sending...
I20260808 07:05:36.551362 21153 ts_manager.cc:194] Registered new tserver with Master: 4e786468c5b9462e98c10e837f4e6b5d (127.26.23.129:36395)
I20260808 07:05:36.552278 21153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:52475
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:05:36.569067 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:46447
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:36.650236 21455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:36.650422 21455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:36.650445 21455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:36.651547 21455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:36.651582 21455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:36.651605 21455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:36.653012 21455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:36.653188 21455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:36.653365 21455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:36.658228 21465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:36.658390 21455 server_base.cc:1034] running on GCE node
W20260808 07:05:36.658236 21468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.658244 21464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:36.658706 21455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:36.658954 21455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:36.660082 21455 hybrid_clock.cc:648] HybridClock initialized: now 1786172736660068 us; error 30 us; skew 500 ppm
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:36.662503 21455 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:05:36.662899 21455 webserver.cc:460] Webserver started at http://127.26.23.130:40863/ using document root <none> and password file <none>
I20260808 07:05:36.663089 21455 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:36.663131 21455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:36.663223 21455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:36.664216 21455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "10ab702381c047e4a6af2e3d997c9299"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "d360bf1ed0edfe7b3326bb67e3e50a24"
server_key_iv: "5c72f58ecbc625e15c7337127661f0fa"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.664502 21455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "10ab702381c047e4a6af2e3d997c9299"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "d360bf1ed0edfe7b3326bb67e3e50a24"
server_key_iv: "5c72f58ecbc625e15c7337127661f0fa"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.665688 21455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:36.666350 21479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.666491 21455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:36.666576 21455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "10ab702381c047e4a6af2e3d997c9299"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "d360bf1ed0edfe7b3326bb67e3e50a24"
server_key_iv: "5c72f58ecbc625e15c7337127661f0fa"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.666659 21455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:36.685422 21455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:36.687635 21455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:36.687773 21455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:36.687989 21455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:36.688288 21455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:36.688323 21455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.688351 21455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:36.688369 21455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.693850 21455 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:43599
I20260808 07:05:36.693890 21657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:43599 every 8 connection(s)
I20260808 07:05:36.694211 21455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:36.702826 21239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.694891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:36571 (local address 127.26.23.190:46447)
0808 07:05:36.694951 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.694954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.695142 (+ 188us) server_negotiation.cc:407] Connection header received
0808 07:05:36.695681 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.695683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.695696 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.695745 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:36.696671 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.697188 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.698141 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.698361 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.698419 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.700412 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:36.700415 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:36.700415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:36.700422 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:36.701506 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.701855 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.701856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.701856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.701902 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.702186 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.702187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.702187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.702300 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:36.702352 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.702678 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.702762 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:36.702865 21660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.694850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:46447 (local address 127.26.23.130:36571)
0808 07:05:36.695020 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.695058 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.695540 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.695829 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.695833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.696389 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:36.696575 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.696580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.697269 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.697270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.698054 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.698057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.698433 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.698434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.698557 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.698965 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:36.698973 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:36.700328 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:36.701574 (+ 1246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:36.701581 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:36.701583 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:36.701797 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:36.701974 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:36.701975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:36.701976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:36.702080 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:36.702351 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:36.702355 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:36.702467 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.702548 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.702702 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":79,"threads_started":1}
I20260808 07:05:36.703320 21658 heartbeater.cc:347] Connected to a master server at 127.26.23.190:46447
I20260808 07:05:36.703414 21658 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:36.703598 21658 heartbeater.cc:511] Master 127.26.23.190:46447 requested a full tablet report, sending...
I20260808 07:05:36.703985 21153 ts_manager.cc:194] Registered new tserver with Master: 10ab702381c047e4a6af2e3d997c9299 (127.26.23.130:43599)
I20260808 07:05:36.704244 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 21455
I20260808 07:05:36.704342 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:36.704376 21153 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:36571
I20260808 07:05:36.704533 26718 external_mini_cluster.cc:1428] Setting key f94a9534fac7d451190c914dc9cf200e
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:05:36.728384 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:46447
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:36.809546 21665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:36.809749 21665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:36.809772 21665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:36.810913 21665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:36.810954 21665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:36.810981 21665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:36.812402 21665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:46447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:36.812623 21665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:36.812821 21665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:36.817584 21675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.817646 21680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:36.817592 21678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:36.817780 21665 server_base.cc:1034] running on GCE node
I20260808 07:05:36.818073 21665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:36.818321 21665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:36.819451 21665 hybrid_clock.cc:648] HybridClock initialized: now 1786172736819443 us; error 29 us; skew 500 ppm
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:36.821846 21665 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:05:36.822283 21665 webserver.cc:460] Webserver started at http://127.26.23.131:45169/ using document root <none> and password file <none>
I20260808 07:05:36.822470 21665 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:36.822510 21665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:36.822643 21665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:36.823563 21665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "b2cd325503f74a968bf05e79348ecdfb"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "ec0e745deecba00effaf594f71afd9ca"
server_key_iv: "35dca72bf5eb38bb415d31bbe3b9e9b2"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.823871 21665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "b2cd325503f74a968bf05e79348ecdfb"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "ec0e745deecba00effaf594f71afd9ca"
server_key_iv: "35dca72bf5eb38bb415d31bbe3b9e9b2"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.825037 21665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:36.825786 21689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.825943 21665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:36.826030 21665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "b2cd325503f74a968bf05e79348ecdfb"
format_stamp: "Formatted at 2026-08-08 07:05:36 on dist-test-slave-zj8q"
server_key: "ec0e745deecba00effaf594f71afd9ca"
server_key_iv: "35dca72bf5eb38bb415d31bbe3b9e9b2"
server_key_version: "encryptionkey@0"
I20260808 07:05:36.826092 21665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:36.836082 21665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:36.837710 21665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:36.837836 21665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:36.838016 21665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:36.838325 21665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:36.838361 21665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.838387 21665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:36.838405 21665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:36.843971 21665 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:39687
I20260808 07:05:36.844008 21867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:39687 every 8 connection(s)
I20260808 07:05:36.844280 21665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
Aug 08 07:05:36 dist-test-slave-zj8q krb5kdc[21087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172736, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:36.852665 21239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.844901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:40709 (local address 127.26.23.190:46447)
0808 07:05:36.844943 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.844946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.845137 (+ 191us) server_negotiation.cc:407] Connection header received
0808 07:05:36.845592 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.845593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.845603 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.845658 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:36.846568 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.847081 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.848031 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.848222 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.848273 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.850075 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:36.850077 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:36.850077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:36.850084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:36.851362 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.851778 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.851779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.851779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.851829 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.852085 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.852085 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.852086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.852180 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:36.852224 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.852474 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.852599 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:05:36.852708 21870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.844888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:46447 (local address 127.26.23.131:40709)
0808 07:05:36.845025 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.845058 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.845502 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.845710 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.845713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.846306 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:36.846494 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.846499 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.847150 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.847150 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.847962 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.847965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.848279 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.848280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.848370 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.848747 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:36.848755 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:36.850001 (+ 1246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:36.851440 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:36.851447 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:36.851449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:36.851716 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:36.851910 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:36.851911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:36.851911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:36.852029 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:36.852225 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:36.852228 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:36.852332 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.852409 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.852527 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260808 07:05:36.853091 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 21665
I20260808 07:05:36.853193 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:36.853219 21868 heartbeater.cc:347] Connected to a master server at 127.26.23.190:46447
I20260808 07:05:36.853313 21868 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:36.853428 26718 external_mini_cluster.cc:1428] Setting key c6245e77c4e18a24d58573655b85f3e0
I20260808 07:05:36.853495 21868 heartbeater.cc:511] Master 127.26.23.190:46447 requested a full tablet report, sending...
I20260808 07:05:36.853869 21152 ts_manager.cc:194] Registered new tserver with Master: b2cd325503f74a968bf05e79348ecdfb (127.26.23.131:39687)
I20260808 07:05:36.854332 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:36.854346 21152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:40709
I20260808 07:05:36.861442 21239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.855810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57488 (local address 127.26.23.190:46447)
0808 07:05:36.855846 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.855848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.855948 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:05:36.855993 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.855994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.856001 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.856048 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:36.856665 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.857238 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.857957 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.858258 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.858309 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.859299 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:36.859301 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:36.859301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:36.859308 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:36.860394 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.860732 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.860733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.860733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.860789 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:36.860948 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:36.860949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:36.860949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:36.861080 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:36.861166 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.861288 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.861359 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 07:05:36.863011 21152 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:36.864557 21152 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:36.870766 21884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.866570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:43599 (local address 127.0.0.1:38216)
0808 07:05:36.866731 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.866769 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.866835 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.867439 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.867440 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.867441 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:36.867470 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.867471 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.868299 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.868300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.869630 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.869634 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.870469 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.870470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.870561 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.870575 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.870639 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.870691 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":70,"threads_started":1}
I20260808 07:05:36.870923 21890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.866918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46672 (local address 127.26.23.131:39687)
0808 07:05:36.867086 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.867090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.867129 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:05:36.867207 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.867209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.867224 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.867371 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:36.867428 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.868536 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.869846 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.870581 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.870661 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.870712 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.870802 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.870837 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":85,"threads_started":1}
I20260808 07:05:36.870955 21888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.866761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:39687 (local address 127.0.0.1:46672)
0808 07:05:36.867073 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.867082 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.867144 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.867305 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.867306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.867308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:36.867362 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.867365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.868648 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.868649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.869767 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.869769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.870676 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.870677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.870734 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.870738 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.870786 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.870820 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":39,"thread_start_us":44,"threads_started":1}
I20260808 07:05:36.871243 21885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.866681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38216 (local address 127.26.23.130:43599)
0808 07:05:36.867275 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.867280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.867289 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:36.867324 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.867325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.867340 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.867444 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:36.867520 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.868205 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.869716 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.870392 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.870458 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.870518 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.871126 (+ 608us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.871169 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":83,"threads_started":1}
I20260808 07:05:36.871629 21887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.866691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47198 (local address 127.26.23.129:36395)
0808 07:05:36.866900 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.866905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.867023 (+ 118us) server_negotiation.cc:407] Connection header received
0808 07:05:36.867077 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.867080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.867100 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.867189 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:36.867565 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.868649 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.869832 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.870586 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.870656 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.870712 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.871498 (+ 786us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.871546 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":93,"threads_started":1}
I20260808 07:05:36.871667 21762 tablet_service.cc:1467] Processing CreateTablet for tablet dafe4594a24c4c3d895e68c1e6e8e088 (DEFAULT_TABLE table=test-table [id=845af955ccd5469cb9f8761b0849b3ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:36.871861 21883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.866572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36395 (local address 127.0.0.1:47198)
0808 07:05:36.866941 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.866949 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.866997 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.867207 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.867210 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.867213 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:36.867280 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.867282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.868740 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.868741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.869748 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.869751 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.871344 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.871345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.871409 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.871413 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.871468 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.871798 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":57,"threads_started":1}
I20260808 07:05:36.871887 21556 tablet_service.cc:1467] Processing CreateTablet for tablet dafe4594a24c4c3d895e68c1e6e8e088 (DEFAULT_TABLE table=test-table [id=845af955ccd5469cb9f8761b0849b3ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:36.872020 21762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dafe4594a24c4c3d895e68c1e6e8e088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:36.872138 21556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dafe4594a24c4c3d895e68c1e6e8e088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:36.874776 21892 tablet_bootstrap.cc:492] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Bootstrap starting.
I20260808 07:05:36.874979 21347 tablet_service.cc:1467] Processing CreateTablet for tablet dafe4594a24c4c3d895e68c1e6e8e088 (DEFAULT_TABLE table=test-table [id=845af955ccd5469cb9f8761b0849b3ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:36.875262 21347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dafe4594a24c4c3d895e68c1e6e8e088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:36.875345 21892 tablet_bootstrap.cc:654] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:36.875787 21892 log.cc:824] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:36.876070 21893 tablet_bootstrap.cc:492] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Bootstrap starting.
I20260808 07:05:36.876626 21892 tablet_bootstrap.cc:492] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: No bootstrap required, opened a new log
I20260808 07:05:36.876668 21893 tablet_bootstrap.cc:654] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:36.876716 21892 ts_tablet_manager.cc:1397] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:36.877178 21893 log.cc:824] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:36.877938 21893 tablet_bootstrap.cc:492] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: No bootstrap required, opened a new log
I20260808 07:05:36.878006 21893 ts_tablet_manager.cc:1397] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:36.878295 21899 tablet_bootstrap.cc:492] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: Bootstrap starting.
I20260808 07:05:36.878620 21892 raft_consensus.cc:348] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.878803 21899 tablet_bootstrap.cc:654] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:36.878816 21892 raft_consensus.cc:374] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:36.878854 21892 raft_consensus.cc:729] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cd325503f74a968bf05e79348ecdfb, State: Initialized, Role: FOLLOWER
I20260808 07:05:36.878988 21892 consensus_queue.cc:260] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.879257 21892 ts_tablet_manager.cc:1428] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:36.879305 21899 log.cc:824] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:36.879407 21868 heartbeater.cc:503] Master 127.26.23.190:46447 was elected leader, sending a full tablet report...
I20260808 07:05:36.879873 21893 raft_consensus.cc:348] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.880003 21893 raft_consensus.cc:374] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:36.880034 21893 raft_consensus.cc:729] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ab702381c047e4a6af2e3d997c9299, State: Initialized, Role: FOLLOWER
I20260808 07:05:36.880067 21899 tablet_bootstrap.cc:492] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: No bootstrap required, opened a new log
I20260808 07:05:36.880134 21899 ts_tablet_manager.cc:1397] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:36.880170 21893 consensus_queue.cc:260] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.880430 21893 ts_tablet_manager.cc:1428] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:36.880486 21658 heartbeater.cc:503] Master 127.26.23.190:46447 was elected leader, sending a full tablet report...
I20260808 07:05:36.881768 21899 raft_consensus.cc:348] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.881897 21899 raft_consensus.cc:374] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:36.881917 21899 raft_consensus.cc:729] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e786468c5b9462e98c10e837f4e6b5d, State: Initialized, Role: FOLLOWER
I20260808 07:05:36.882001 21899 consensus_queue.cc:260] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.882289 21899 ts_tablet_manager.cc:1428] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:05:36.882329 21448 heartbeater.cc:503] Master 127.26.23.190:46447 was elected leader, sending a full tablet report...
W20260808 07:05:36.944743 21659 tablet.cc:2369] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:36.970852 21906 raft_consensus.cc:482] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:36.970988 21906 raft_consensus.cc:504] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.971408 21906 leader_election.cc:288] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e786468c5b9462e98c10e837f4e6b5d (127.26.23.129:36395), b2cd325503f74a968bf05e79348ecdfb (127.26.23.131:39687)
I20260808 07:05:36.974082 21660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.971566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36395 (local address 127.26.23.130:58783)
0808 07:05:36.971631 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.971644 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.971687 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.971821 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.971822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.971823 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:36.971899 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.971901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.972534 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.972535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.973269 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.973271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.973833 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.973834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.973912 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.973915 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.973961 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.974004 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:05:36.974082 21887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.971667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:58783 (local address 127.26.23.129:36395)
0808 07:05:36.971709 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.971711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.971720 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:36.971748 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.971749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.971757 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.971809 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:36.971963 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.972457 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.973361 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.973754 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.973820 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.973829 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.973976 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.974015 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:05:36.974215 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.971576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:39687 (local address 127.26.23.130:53775)
0808 07:05:36.971781 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:36.971790 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:36.971848 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:36.971966 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:36.971967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:36.971969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:36.972049 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.972050 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.972679 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.972680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.973411 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:36.973413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.973951 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.973952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:36.974020 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.974023 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:36.974069 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:36.974108 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":129,"threads_started":1}
I20260808 07:05:36.974388 21890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.971692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:53775 (local address 127.26.23.131:39687)
0808 07:05:36.971749 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.971751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.971854 (+ 103us) server_negotiation.cc:407] Connection header received
0808 07:05:36.971902 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.971903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.971912 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.971959 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:36.972111 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.972574 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.973501 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.973874 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.973937 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.973945 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.974086 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.974323 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:05:36.974462 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafe4594a24c4c3d895e68c1e6e8e088" candidate_uuid: "10ab702381c047e4a6af2e3d997c9299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e786468c5b9462e98c10e837f4e6b5d" is_pre_election: true
I20260808 07:05:36.974642 21376 raft_consensus.cc:2454] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ab702381c047e4a6af2e3d997c9299 in term 0.
I20260808 07:05:36.974659 21790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafe4594a24c4c3d895e68c1e6e8e088" candidate_uuid: "10ab702381c047e4a6af2e3d997c9299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cd325503f74a968bf05e79348ecdfb" is_pre_election: true
I20260808 07:05:36.974807 21790 raft_consensus.cc:2454] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ab702381c047e4a6af2e3d997c9299 in term 0.
I20260808 07:05:36.974908 21480 leader_election.cc:302] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ab702381c047e4a6af2e3d997c9299, 4e786468c5b9462e98c10e837f4e6b5d; no voters:
I20260808 07:05:36.975035 21906 raft_consensus.cc:2781] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:36.975095 21906 raft_consensus.cc:482] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:36.975140 21906 raft_consensus.cc:3037] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:36.975880 21906 raft_consensus.cc:504] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.976007 21906 leader_election.cc:288] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [CANDIDATE]: Term 1 election: Requested vote from peers 4e786468c5b9462e98c10e837f4e6b5d (127.26.23.129:36395), b2cd325503f74a968bf05e79348ecdfb (127.26.23.131:39687)
I20260808 07:05:36.976171 21790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafe4594a24c4c3d895e68c1e6e8e088" candidate_uuid: "10ab702381c047e4a6af2e3d997c9299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cd325503f74a968bf05e79348ecdfb"
I20260808 07:05:36.976222 21376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dafe4594a24c4c3d895e68c1e6e8e088" candidate_uuid: "10ab702381c047e4a6af2e3d997c9299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e786468c5b9462e98c10e837f4e6b5d"
I20260808 07:05:36.976244 21790 raft_consensus.cc:3037] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:36.976300 21376 raft_consensus.cc:3037] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:36.976975 21376 raft_consensus.cc:2454] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ab702381c047e4a6af2e3d997c9299 in term 1.
I20260808 07:05:36.976985 21790 raft_consensus.cc:2454] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ab702381c047e4a6af2e3d997c9299 in term 1.
I20260808 07:05:36.977149 21480 leader_election.cc:302] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ab702381c047e4a6af2e3d997c9299, 4e786468c5b9462e98c10e837f4e6b5d; no voters:
I20260808 07:05:36.977240 21906 raft_consensus.cc:2781] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:36.977416 21906 raft_consensus.cc:686] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 1 LEADER]: Becoming Leader. State: Replica: 10ab702381c047e4a6af2e3d997c9299, State: Running, Role: LEADER
I20260808 07:05:36.977505 21906 consensus_queue.cc:237] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } }
I20260808 07:05:36.978324 21153 catalog_manager.cc:5495] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10ab702381c047e4a6af2e3d997c9299 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "10ab702381c047e4a6af2e3d997c9299" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ab702381c047e4a6af2e3d997c9299" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:36.984145 21885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:36.982001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38226 (local address 127.26.23.130:43599)
0808 07:05:36.982063 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:36.982065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:36.982072 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:05:36.982101 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:36.982102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:36.982116 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:36.982214 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:36.982335 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.982774 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.983469 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:36.983656 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:36.983707 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:36.983855 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:36.983949 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:36.984018 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:36.984054 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 07:05:36.984074 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:05:36.985711 21376 raft_consensus.cc:1261] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 1 FOLLOWER]: Refusing update from remote peer 10ab702381c047e4a6af2e3d997c9299: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:36.985997 21790 raft_consensus.cc:1261] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 1 FOLLOWER]: Refusing update from remote peer 10ab702381c047e4a6af2e3d997c9299: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:36.986032 21912 consensus_queue.cc:1035] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e786468c5b9462e98c10e837f4e6b5d" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 36395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:36.986279 21906 consensus_queue.cc:1035] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cd325503f74a968bf05e79348ecdfb" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:36.988245 21918 mvcc.cc:205] Tried to move back new op lower bound from 7316163530691178496 to 7316163530660438016. Current Snapshot: MvccSnapshot[applied={T|T < 7316163530691178496}]
I20260808 07:05:36.988824 21920 mvcc.cc:205] Tried to move back new op lower bound from 7316163530691178496 to 7316163530660438016. Current Snapshot: MvccSnapshot[applied={T|T < 7316163530691178496}]
I20260808 07:05:36.989364 21921 mvcc.cc:205] Tried to move back new op lower bound from 7316163530691178496 to 7316163530660438016. Current Snapshot: MvccSnapshot[applied={T|T < 7316163530691178496}]
I20260808 07:05:36.990657 21153 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:36.990736 21153 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57488:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:36.991417 21153 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdbf38bb2b01413a826ac376ad62118a: Sending DeleteTablet for 3 replicas of tablet dafe4594a24c4c3d895e68c1e6e8e088
I20260808 07:05:36.991859 21762 tablet_service.cc:1514] Processing DeleteTablet for tablet dafe4594a24c4c3d895e68c1e6e8e088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:36 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:46672
I20260808 07:05:36.991878 21347 tablet_service.cc:1514] Processing DeleteTablet for tablet dafe4594a24c4c3d895e68c1e6e8e088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:36 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:47198
I20260808 07:05:36.992072 21556 tablet_service.cc:1514] Processing DeleteTablet for tablet dafe4594a24c4c3d895e68c1e6e8e088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:36 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:38216
I20260808 07:05:36.992264 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 21257
I20260808 07:05:36.992291 21934 tablet_replica.cc:330] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d: stopping tablet replica
I20260808 07:05:36.992290 21935 tablet_replica.cc:330] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: stopping tablet replica
I20260808 07:05:36.992383 21934 raft_consensus.cc:2229] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:36.992477 21934 raft_consensus.cc:2258] T dafe4594a24c4c3d895e68c1e6e8e088 P 4e786468c5b9462e98c10e837f4e6b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:36.992643 21933 tablet_replica.cc:330] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: stopping tablet replica
I20260808 07:05:36.992733 21933 raft_consensus.cc:2229] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:36.992501 21935 raft_consensus.cc:2229] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:36.992825 21933 raft_consensus.cc:2258] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:36.993003 21935 raft_consensus.cc:2258] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:36.995318 21933 ts_tablet_manager.cc:1905] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:36.996912 21933 ts_tablet_manager.cc:1918] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:36.996990 21933 log.cc:1196] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/dafe4594a24c4c3d895e68c1e6e8e088
I20260808 07:05:36.997263 21933 ts_tablet_manager.cc:1939] T dafe4594a24c4c3d895e68c1e6e8e088 P b2cd325503f74a968bf05e79348ecdfb: Deleting consensus metadata
I20260808 07:05:37.006681 21935 ts_tablet_manager.cc:1905] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:37.008013 21137 catalog_manager.cc:4841] TS b2cd325503f74a968bf05e79348ecdfb (127.26.23.131:39687): tablet dafe4594a24c4c3d895e68c1e6e8e088 (table test-table [id=845af955ccd5469cb9f8761b0849b3ce]) successfully deleted
I20260808 07:05:37.008453 21935 ts_tablet_manager.cc:1918] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:37.008533 21935 log.cc:1196] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/dafe4594a24c4c3d895e68c1e6e8e088
I20260808 07:05:37.008819 21935 ts_tablet_manager.cc:1939] T dafe4594a24c4c3d895e68c1e6e8e088 P 10ab702381c047e4a6af2e3d997c9299: Deleting consensus metadata
I20260808 07:05:37.009258 21137 catalog_manager.cc:4841] TS 10ab702381c047e4a6af2e3d997c9299 (127.26.23.130:43599): tablet dafe4594a24c4c3d895e68c1e6e8e088 (table test-table [id=845af955ccd5469cb9f8761b0849b3ce]) successfully deleted
W20260808 07:05:37.012212 21133 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:36395 (error 108)
I20260808 07:05:37.012723 21883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.012600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:36395 (local address 127.0.0.1:47202)
0808 07:05:37.012651 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.012689 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:36395: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 07:05:37.012784 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 21455
W20260808 07:05:37.012827 21133 catalog_manager.cc:4584] TS 4e786468c5b9462e98c10e837f4e6b5d (127.26.23.129:36395): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dafe4594a24c4c3d895e68c1e6e8e088: Network error: Client connection negotiation failed: client connection to 127.26.23.129:36395: connect: Connection refused (error 111)
I20260808 07:05:37.029688 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 21665
I20260808 07:05:37.038892 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 21109
2026-08-08T07:05:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2063 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T07:05:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:37Z Disabled control of system clock
I20260808 07:05:37.069101 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:36729
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:32815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:36729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:37.149307 21943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:37.149511 21943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:37.149541 21943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:37.150681 21943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:37.150719 21943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:37.150736 21943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:37.150748 21943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:37.150774 21943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:37.152109 21943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:36729
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:36729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:37.152343 21943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:37.152633 21943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:37.157357 21955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.157367 21959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.157370 21956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:37.157579 21943 server_base.cc:1034] running on GCE node
I20260808 07:05:37.157897 21943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:37.158182 21943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:37.159322 21943 hybrid_clock.cc:648] HybridClock initialized: now 1786172737159314 us; error 27 us; skew 500 ppm
I20260808 07:05:37.160476 21943 webserver.cc:460] Webserver started at http://127.26.23.190:41411/ using document root <none> and password file <none>
I20260808 07:05:37.160697 21943 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:37.160742 21943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:37.160835 21943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:37.161847 21943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "55ae8c07b20e4b6b8159e8f70b4138cd"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "bf7ba89a59db1bf0d55ac2bdcc192800"
server_key_iv: "e45898ba9cdaa74b7b00cfff33106f7d"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.162178 21943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "55ae8c07b20e4b6b8159e8f70b4138cd"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "bf7ba89a59db1bf0d55ac2bdcc192800"
server_key_iv: "e45898ba9cdaa74b7b00cfff33106f7d"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.163342 21943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:37.163954 21966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.164100 21943 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.164207 21943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "55ae8c07b20e4b6b8159e8f70b4138cd"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "bf7ba89a59db1bf0d55ac2bdcc192800"
server_key_iv: "e45898ba9cdaa74b7b00cfff33106f7d"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.164273 21943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:37.199955 21943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:37.200378 21943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:37.200523 21943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:37.204425 21943 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:36729
I20260808 07:05:37.204465 22046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:36729 every 8 connection(s)
I20260808 07:05:37.204794 21943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:37.205792 22047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:37.208148 22047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: Bootstrap starting.
I20260808 07:05:37.208694 22047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:37.208935 22047 log.cc:824] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:37.209642 22047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: No bootstrap required, opened a new log
I20260808 07:05:37.211649 22047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36729 } }
I20260808 07:05:37.211790 22047 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:37.211812 22047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ae8c07b20e4b6b8159e8f70b4138cd, State: Initialized, Role: FOLLOWER
I20260808 07:05:37.211920 22047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36729 } }
I20260808 07:05:37.211971 22047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:37.211995 22047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:37.212025 22047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:37.212486 22047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36729 } }
I20260808 07:05:37.212570 22047 leader_election.cc:302] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55ae8c07b20e4b6b8159e8f70b4138cd; no voters:
I20260808 07:05:37.212708 22047 leader_election.cc:288] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:37.212776 22054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:37.212929 22054 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [term 1 LEADER]: Becoming Leader. State: Replica: 55ae8c07b20e4b6b8159e8f70b4138cd, State: Running, Role: LEADER
I20260808 07:05:37.212937 22047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:37.213048 22054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36729 } }
I20260808 07:05:37.213524 22055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36729 } } }
I20260808 07:05:37.213611 22055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:37.213690 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 21943
I20260808 07:05:37.213795 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:37.213770 22056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55ae8c07b20e4b6b8159e8f70b4138cd. Latest consensus state: current_term: 1 leader_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ae8c07b20e4b6b8159e8f70b4138cd" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36729 } } }
I20260808 07:05:37.213826 22056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:37.214001 26718 external_mini_cluster.cc:1428] Setting key 955182b073f131daff70e897e633022a
W20260808 07:05:37.214884 22073 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:37.214946 22073 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:37.214994 22066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:37.215157 22066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:37.216508 22066 catalog_manager.cc:1347] Generated new cluster ID: 31a3562b689d4342a66905d40021e4a4
I20260808 07:05:37.216562 22066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:37.220745 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.214647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47320 (local address 127.26.23.190:36729)
0808 07:05:37.214857 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.214866 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.214896 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:05:37.215662 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.215670 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.215743 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.215886 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:37.216109 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.217467 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.218628 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.219259 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.219377 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.220047 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:37.220050 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:37.220051 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:37.220256 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:37.220297 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:37.220311 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:37.220365 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.220467 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.220540 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":62,"threads_started":1}
I20260808 07:05:37.224125 22066 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:37.224582 22066 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:37.229938 22066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: Generated new TSK 0
I20260808 07:05:37.230080 22066 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:37.232366 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:36729
--builtin_ntp_servers=127.26.23.148:32815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:37.350878 22080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:37.351155 22080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:37.351191 22080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:37.352722 22080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:37.352790 22080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:37.352826 22080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:37.354782 22080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:37.355042 22080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:37.355391 22080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:37.360634 22090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.360575 22088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.360576 22087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:37.360818 22080 server_base.cc:1034] running on GCE node
I20260808 07:05:37.361060 22080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:37.361300 22080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:37.362433 22080 hybrid_clock.cc:648] HybridClock initialized: now 1786172737362412 us; error 38 us; skew 500 ppm
I20260808 07:05:37.363569 22080 webserver.cc:460] Webserver started at http://127.26.23.129:38531/ using document root <none> and password file <none>
I20260808 07:05:37.363790 22080 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:37.363838 22080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:37.363955 22080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:37.365001 22080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "8784d140ce31f5ed541a5430239a6fbc"
server_key_iv: "09194b151f91a86fb284741f7164acdc"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.365334 22080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "8784d140ce31f5ed541a5430239a6fbc"
server_key_iv: "09194b151f91a86fb284741f7164acdc"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.366653 22080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:37.367389 22103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.367553 22080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:37.367637 22080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "8784d140ce31f5ed541a5430239a6fbc"
server_key_iv: "09194b151f91a86fb284741f7164acdc"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.367698 22080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:37.377707 22080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:37.377966 22080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:37.378085 22080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:37.378343 22080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:37.378669 22080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:37.378703 22080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.378731 22080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:37.378747 22080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.384217 22080 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:37115
I20260808 07:05:37.384287 22285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:37115 every 8 connection(s)
I20260808 07:05:37.384565 22080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:37.388592 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 22080
I20260808 07:05:37.388684 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:37.388871 26718 external_mini_cluster.cc:1428] Setting key adaefb6ae41bdfc77e307e1a09b04596
I20260808 07:05:37.389498 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.385230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:52791 (local address 127.26.23.190:36729)
0808 07:05:37.385283 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.385285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.385531 (+ 246us) server_negotiation.cc:407] Connection header received
0808 07:05:37.386001 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.386002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.386012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.386068 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:37.386696 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.387179 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.388105 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.388293 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.388340 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.389252 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:37.389253 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:37.389254 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:37.389258 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:37.389274 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:37.389278 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:37.389328 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.389395 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.389422 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:05:37.389703 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.385213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:36729 (local address 127.26.23.129:52791)
0808 07:05:37.385410 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.385446 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.385925 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.386127 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.386130 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.386138 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:37.386628 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.386632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.387245 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.387245 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.388036 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.388039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.388349 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.388350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.388454 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.388973 (+ 519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:37.388974 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:37.389034 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:37.389063 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:37.389341 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:37.389345 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:37.389347 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.389392 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.389488 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
I20260808 07:05:37.389894 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:36729
--builtin_ntp_servers=127.26.23.148:32815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:05:37.390324 22286 heartbeater.cc:347] Connected to a master server at 127.26.23.190:36729
I20260808 07:05:37.390420 22286 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:37.390610 22286 heartbeater.cc:511] Master 127.26.23.190:36729 requested a full tablet report, sending...
I20260808 07:05:37.391119 21991 ts_manager.cc:194] Registered new tserver with Master: 1be4b5c65a3b4d60a195cbc4026d3ef7 (127.26.23.129:37115)
I20260808 07:05:37.391871 21991 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.129:52791
W20260808 07:05:37.471323 22289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:37.471519 22289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:37.471540 22289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:37.472709 22289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:37.472748 22289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:37.472774 22289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:37.474092 22289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:37.474344 22289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:37.474634 22289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:37.479453 22298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.479480 22297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.479480 22301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:37.479745 22289 server_base.cc:1034] running on GCE node
I20260808 07:05:37.479947 22289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:37.480171 22289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:37.481323 22289 hybrid_clock.cc:648] HybridClock initialized: now 1786172737481304 us; error 28 us; skew 500 ppm
I20260808 07:05:37.482784 22289 webserver.cc:460] Webserver started at http://127.26.23.130:37171/ using document root <none> and password file <none>
I20260808 07:05:37.483007 22289 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:37.483058 22289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:37.483192 22289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:37.484246 22289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "7f3554fb8dce49f1be8a97b9bcbf5994"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "f1513d375d1ae0b9b1ca9c4d5bea81fd"
server_key_iv: "ef13e12906b0cec518820266243f78f0"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.484596 22289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "7f3554fb8dce49f1be8a97b9bcbf5994"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "f1513d375d1ae0b9b1ca9c4d5bea81fd"
server_key_iv: "ef13e12906b0cec518820266243f78f0"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.485903 22289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:05:37.486677 22311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.486833 22289 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.486918 22289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "7f3554fb8dce49f1be8a97b9bcbf5994"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "f1513d375d1ae0b9b1ca9c4d5bea81fd"
server_key_iv: "ef13e12906b0cec518820266243f78f0"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.486986 22289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:37.518358 22289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:37.518646 22289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:37.518777 22289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:37.518977 22289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:37.519291 22289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:37.519326 22289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.519354 22289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:37.519378 22289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.524821 22289 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:44471
I20260808 07:05:37.524888 22496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:44471 every 8 connection(s)
I20260808 07:05:37.525189 22289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:37.525456 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 22289
I20260808 07:05:37.525561 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:37.525790 26718 external_mini_cluster.cc:1428] Setting key db7b171d7730ca939be0b66771c0abd7
I20260808 07:05:37.526878 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:36729
--builtin_ntp_servers=127.26.23.148:32815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:05:37.530709 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.525977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:48675 (local address 127.26.23.190:36729)
0808 07:05:37.526024 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.526026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.526364 (+ 338us) server_negotiation.cc:407] Connection header received
0808 07:05:37.526956 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.526957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.526969 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.527031 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:37.527864 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.528350 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.529376 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.529632 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.529694 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.530448 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:37.530449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:37.530450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:37.530455 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:37.530472 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:37.530476 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:37.530524 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.530599 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.530627 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:37.530905 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.525980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:36729 (local address 127.26.23.130:48675)
0808 07:05:37.526207 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.526270 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.526853 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.527110 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.527115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.527124 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:37.527772 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.527780 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.528439 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.528440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.529293 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.529296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.529704 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.529705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.529808 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.530317 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:37.530317 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:37.530345 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:37.530368 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:37.530529 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:37.530534 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:37.530537 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.530598 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.530697 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":92,"threads_started":1}
I20260808 07:05:37.531329 22497 heartbeater.cc:347] Connected to a master server at 127.26.23.190:36729
I20260808 07:05:37.531409 22497 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:37.531574 22497 heartbeater.cc:511] Master 127.26.23.190:36729 requested a full tablet report, sending...
I20260808 07:05:37.531899 21991 ts_manager.cc:194] Registered new tserver with Master: 7f3554fb8dce49f1be8a97b9bcbf5994 (127.26.23.130:44471)
I20260808 07:05:37.532255 21991 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.130:48675
W20260808 07:05:37.608801 22511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:37.609000 22511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:37.609028 22511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:37.610193 22511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:37.610239 22511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:37.610271 22511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:37.611613 22511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:32815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:37.611855 22511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:37.612151 22511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:37.617070 22516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.617082 22520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:37.617085 22517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:37.617143 22511 server_base.cc:1034] running on GCE node
I20260808 07:05:37.617479 22511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:37.617753 22511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:37.618888 22511 hybrid_clock.cc:648] HybridClock initialized: now 1786172737618873 us; error 30 us; skew 500 ppm
I20260808 07:05:37.620074 22511 webserver.cc:460] Webserver started at http://127.26.23.131:42869/ using document root <none> and password file <none>
I20260808 07:05:37.620296 22511 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:37.620339 22511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:37.620463 22511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:37.621523 22511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "e3412aebc42c4b6c8f8316f7f632b50f"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "e1c7ced56dd969dd3486a4790efc20b8"
server_key_iv: "550c2027fcf68cbd4665549d04157c5d"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.621872 22511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "e3412aebc42c4b6c8f8316f7f632b50f"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "e1c7ced56dd969dd3486a4790efc20b8"
server_key_iv: "550c2027fcf68cbd4665549d04157c5d"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.623139 22511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:37.623769 22529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.623903 22511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:37.623996 22511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "e3412aebc42c4b6c8f8316f7f632b50f"
format_stamp: "Formatted at 2026-08-08 07:05:37 on dist-test-slave-zj8q"
server_key: "e1c7ced56dd969dd3486a4790efc20b8"
server_key_iv: "550c2027fcf68cbd4665549d04157c5d"
server_key_version: "encryptionkey@0"
I20260808 07:05:37.624059 22511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:37.632828 22511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:37.633071 22511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:37.633190 22511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:37.633374 22511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:37.633673 22511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:37.633706 22511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.633734 22511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:37.633759 22511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:37.639201 22511 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:39521
I20260808 07:05:37.639245 22714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:39521 every 8 connection(s)
I20260808 07:05:37.639530 22511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:37.642634 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 22511
I20260808 07:05:37.642736 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:37.642930 26718 external_mini_cluster.cc:1428] Setting key cbede4ff47f343f71eac8e5324d60a92
I20260808 07:05:37.644603 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.640185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:49535 (local address 127.26.23.190:36729)
0808 07:05:37.640238 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.640240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.640416 (+ 176us) server_negotiation.cc:407] Connection header received
0808 07:05:37.640917 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.640919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.640932 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.640983 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:37.641620 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.642124 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.643392 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.643632 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.643689 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.644347 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:37.644348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:37.644348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:37.644353 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:37.644368 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:37.644372 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:37.644419 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.644494 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.644524 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:05:37.644819 22718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.640147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:36729 (local address 127.26.23.131:49535)
0808 07:05:37.640307 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.640339 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.640821 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.641048 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.641051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.641059 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:37.641530 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.641534 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.642245 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.642246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.643314 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.643317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.643706 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.643707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.643840 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.644226 (+ 386us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:37.644227 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:37.644253 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:37.644274 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:37.644424 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:37.644429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:37.644432 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.644491 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.644588 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260808 07:05:37.645257 22715 heartbeater.cc:347] Connected to a master server at 127.26.23.190:36729
I20260808 07:05:37.645340 22715 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:37.645478 22715 heartbeater.cc:511] Master 127.26.23.190:36729 requested a full tablet report, sending...
I20260808 07:05:37.645836 21991 ts_manager.cc:194] Registered new tserver with Master: e3412aebc42c4b6c8f8316f7f632b50f (127.26.23.131:39521)
I20260808 07:05:37.646219 21991 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.131:49535
I20260808 07:05:37.654693 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:37.658700 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.656028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47332 (local address 127.26.23.190:36729)
0808 07:05:37.656082 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.656084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.656184 (+ 100us) server_negotiation.cc:407] Connection header received
0808 07:05:37.656227 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.656228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.656238 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.656282 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:37.656397 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.656878 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.657679 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.657858 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.657905 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.658459 (+ 554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:37.658460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:37.658461 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:37.658464 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:37.658477 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:37.658481 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:37.658518 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.658607 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.658628 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:05:37.660014 21991 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47332:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:37.661571 21991 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:37.667546 22728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.663570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44471 (local address 127.0.0.1:53534)
0808 07:05:37.663992 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.664003 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.664058 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.664421 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.664422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.664424 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:37.664469 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.664471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.665284 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.665285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.666500 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.666503 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.667231 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.667232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.667306 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.667320 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.667389 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.667440 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":89,"threads_started":1}
I20260808 07:05:37.667555 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.663831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.26.23.130:44471)
0808 07:05:37.664048 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.664052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.664062 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:37.664136 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.664138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.664154 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.664355 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:37.664527 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.665210 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.666592 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.667157 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.667216 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.667307 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.667432 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.667475 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":102,"threads_started":1}
I20260808 07:05:37.667654 22725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.663557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:37115 (local address 127.0.0.1:36564)
0808 07:05:37.663759 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.663794 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.663851 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.664355 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.664355 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.664358 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:37.664398 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.664399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.665668 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.665669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.666531 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.666534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.667441 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.667442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.667502 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.667507 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.667539 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.667580 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":3,"thread_start_us":99,"threads_started":1}
I20260808 07:05:37.668010 22727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.663593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:39521 (local address 127.0.0.1:52468)
0808 07:05:37.664013 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.664032 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.664082 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.664263 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.664265 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.664267 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:37.664333 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.664335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.665621 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.665622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.666729 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.666731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.667732 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.667733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.667805 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.667809 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.667898 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.667937 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":75,"threads_started":1}
I20260808 07:05:37.668043 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.663825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.26.23.131:39521)
0808 07:05:37.663985 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.663990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.664088 (+ 98us) server_negotiation.cc:407] Connection header received
0808 07:05:37.664144 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.664146 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.664158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.664238 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:37.664413 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.665532 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.666830 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.667562 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.667617 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.667697 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.667922 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.667963 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260808 07:05:37.668071 22729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.663651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36564 (local address 127.26.23.129:37115)
0808 07:05:37.664190 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.664194 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.664202 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:37.664239 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.664241 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.664257 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.664467 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:37.664546 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.665609 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.666617 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.667348 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.667810 (+ 462us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.667924 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.667949 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.667986 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":82,"threads_started":1}
I20260808 07:05:37.668553 22381 tablet_service.cc:1467] Processing CreateTablet for tablet d7ca4423b910412aaee7f820c6bd3b70 (DEFAULT_TABLE table=test-table [id=cbea4e8273374cd3933f8852c45acfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:37.668593 22176 tablet_service.cc:1467] Processing CreateTablet for tablet d7ca4423b910412aaee7f820c6bd3b70 (DEFAULT_TABLE table=test-table [id=cbea4e8273374cd3933f8852c45acfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:37.668668 22618 tablet_service.cc:1467] Processing CreateTablet for tablet d7ca4423b910412aaee7f820c6bd3b70 (DEFAULT_TABLE table=test-table [id=cbea4e8273374cd3933f8852c45acfb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:37.668920 22381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7ca4423b910412aaee7f820c6bd3b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:37.668920 22176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7ca4423b910412aaee7f820c6bd3b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:37.668977 22618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7ca4423b910412aaee7f820c6bd3b70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:37.671764 22732 tablet_bootstrap.cc:492] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Bootstrap starting.
I20260808 07:05:37.672133 22733 tablet_bootstrap.cc:492] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Bootstrap starting.
I20260808 07:05:37.672343 22734 tablet_bootstrap.cc:492] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: Bootstrap starting.
I20260808 07:05:37.672564 22732 tablet_bootstrap.cc:654] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:37.672878 22733 tablet_bootstrap.cc:654] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:37.672886 22732 log.cc:824] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:37.672941 22734 tablet_bootstrap.cc:654] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:37.673189 22733 log.cc:824] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:37.673221 22734 log.cc:824] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:37.673895 22732 tablet_bootstrap.cc:492] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: No bootstrap required, opened a new log
I20260808 07:05:37.673895 22733 tablet_bootstrap.cc:492] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: No bootstrap required, opened a new log
I20260808 07:05:37.673969 22732 ts_tablet_manager.cc:1397] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:37.673969 22733 ts_tablet_manager.cc:1397] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:37.674448 22734 tablet_bootstrap.cc:492] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: No bootstrap required, opened a new log
I20260808 07:05:37.674510 22734 ts_tablet_manager.cc:1397] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:37.676442 22733 raft_consensus.cc:348] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.676446 22732 raft_consensus.cc:348] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.676621 22733 raft_consensus.cc:374] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:37.676621 22732 raft_consensus.cc:374] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:37.676544 22734 raft_consensus.cc:348] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.676671 22733 raft_consensus.cc:729] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f3554fb8dce49f1be8a97b9bcbf5994, State: Initialized, Role: FOLLOWER
I20260808 07:05:37.676671 22732 raft_consensus.cc:729] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3412aebc42c4b6c8f8316f7f632b50f, State: Initialized, Role: FOLLOWER
I20260808 07:05:37.676687 22734 raft_consensus.cc:374] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:37.676719 22734 raft_consensus.cc:729] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be4b5c65a3b4d60a195cbc4026d3ef7, State: Initialized, Role: FOLLOWER
I20260808 07:05:37.676800 22732 consensus_queue.cc:260] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.676827 22734 consensus_queue.cc:260] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.676827 22733 consensus_queue.cc:260] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.677062 22732 ts_tablet_manager.cc:1428] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:37.677062 22733 ts_tablet_manager.cc:1428] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:37.677069 22734 ts_tablet_manager.cc:1428] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 07:05:37.677116 22286 heartbeater.cc:503] Master 127.26.23.190:36729 was elected leader, sending a full tablet report...
I20260808 07:05:37.677196 22497 heartbeater.cc:503] Master 127.26.23.190:36729 was elected leader, sending a full tablet report...
I20260808 07:05:37.677392 22715 heartbeater.cc:503] Master 127.26.23.190:36729 was elected leader, sending a full tablet report...
W20260808 07:05:37.775823 22504 tablet.cc:2369] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:37.840927 22748 raft_consensus.cc:482] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:37.841091 22748 raft_consensus.cc:504] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.841485 22748 leader_election.cc:288] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3412aebc42c4b6c8f8316f7f632b50f (127.26.23.131:39521), 7f3554fb8dce49f1be8a97b9bcbf5994 (127.26.23.130:44471)
I20260808 07:05:37.845155 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.841720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:36933 (local address 127.26.23.131:39521)
0808 07:05:37.841780 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.841782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.841792 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:37.841866 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.841867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.841878 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.841932 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:37.842177 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.842786 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.844176 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.844760 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.844837 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.844846 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.845042 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.845082 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 07:05:37.845170 22731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.841782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:42183 (local address 127.26.23.130:44471)
0808 07:05:37.841828 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.841830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.841942 (+ 112us) server_negotiation.cc:407] Connection header received
0808 07:05:37.841992 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.841993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.842003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.842059 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:37.842331 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.842908 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.844194 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.844760 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.844837 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.844846 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.845042 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.845082 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:05:37.845185 22288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.841661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:39521 (local address 127.26.23.129:36933)
0808 07:05:37.841724 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.841735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.841780 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.841961 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.841963 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.841965 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:37.842045 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.842048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.842863 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.842864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.844088 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.844091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.844867 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.844868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.844960 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.844968 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.845030 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.845075 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":4}
I20260808 07:05:37.845191 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.841700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:44471 (local address 127.26.23.129:42183)
0808 07:05:37.841869 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.841878 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:37.841931 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:37.842180 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:37.842181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:37.842184 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:37.842256 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.842258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.843001 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.843002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.844120 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:37.844121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.844867 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.844868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:37.844960 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.844969 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:05:37.845030 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:05:37.845075 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":6,"thread_start_us":103,"threads_started":1}
I20260808 07:05:37.845640 22418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7ca4423b910412aaee7f820c6bd3b70" candidate_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" is_pre_election: true
I20260808 07:05:37.845642 22649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7ca4423b910412aaee7f820c6bd3b70" candidate_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" is_pre_election: true
I20260808 07:05:37.845785 22649 raft_consensus.cc:2454] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be4b5c65a3b4d60a195cbc4026d3ef7 in term 0.
I20260808 07:05:37.845795 22418 raft_consensus.cc:2454] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be4b5c65a3b4d60a195cbc4026d3ef7 in term 0.
I20260808 07:05:37.846011 22108 leader_election.cc:302] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be4b5c65a3b4d60a195cbc4026d3ef7, 7f3554fb8dce49f1be8a97b9bcbf5994; no voters:
I20260808 07:05:37.846203 22748 raft_consensus.cc:2781] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:37.846256 22748 raft_consensus.cc:482] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:37.846279 22748 raft_consensus.cc:3037] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:37.846976 22748 raft_consensus.cc:504] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.847106 22748 leader_election.cc:288] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [CANDIDATE]: Term 1 election: Requested vote from peers e3412aebc42c4b6c8f8316f7f632b50f (127.26.23.131:39521), 7f3554fb8dce49f1be8a97b9bcbf5994 (127.26.23.130:44471)
I20260808 07:05:37.847276 22649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7ca4423b910412aaee7f820c6bd3b70" candidate_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3412aebc42c4b6c8f8316f7f632b50f"
I20260808 07:05:37.847271 22418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7ca4423b910412aaee7f820c6bd3b70" candidate_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994"
I20260808 07:05:37.847352 22418 raft_consensus.cc:3037] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:37.847352 22649 raft_consensus.cc:3037] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:37.848246 22649 raft_consensus.cc:2454] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be4b5c65a3b4d60a195cbc4026d3ef7 in term 1.
I20260808 07:05:37.848246 22418 raft_consensus.cc:2454] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be4b5c65a3b4d60a195cbc4026d3ef7 in term 1.
I20260808 07:05:37.848465 22105 leader_election.cc:302] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be4b5c65a3b4d60a195cbc4026d3ef7, e3412aebc42c4b6c8f8316f7f632b50f; no voters:
I20260808 07:05:37.848536 22748 raft_consensus.cc:2781] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:37.848676 22748 raft_consensus.cc:686] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [term 1 LEADER]: Becoming Leader. State: Replica: 1be4b5c65a3b4d60a195cbc4026d3ef7, State: Running, Role: LEADER
I20260808 07:05:37.848757 22748 consensus_queue.cc:237] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } }
I20260808 07:05:37.849565 21987 catalog_manager.cc:5495] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be4b5c65a3b4d60a195cbc4026d3ef7 (127.26.23.129). New cstate: current_term: 1 leader_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1be4b5c65a3b4d60a195cbc4026d3ef7" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 37115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 } health_report { overall_health: UNKNOWN } } }
W20260808 07:05:37.885210 22287 tablet.cc:2369] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 07:05:37.889983 22716 tablet.cc:2369] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:37.892112 22729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.889678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36566 (local address 127.26.23.129:37115)
0808 07:05:37.889725 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:37.889727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:37.889733 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:05:37.889764 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:37.889765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:37.889782 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:37.889841 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:37.889995 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.890672 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.891389 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:37.891595 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:37.891649 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:37.891792 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:37.891893 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:37.891963 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:37.892001 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:05:37.892022 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:05:37.893729 22649 raft_consensus.cc:1261] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 1 FOLLOWER]: Refusing update from remote peer 1be4b5c65a3b4d60a195cbc4026d3ef7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:37.893730 22418 raft_consensus.cc:1261] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 1 FOLLOWER]: Refusing update from remote peer 1be4b5c65a3b4d60a195cbc4026d3ef7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:37.894044 22750 consensus_queue.cc:1035] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3412aebc42c4b6c8f8316f7f632b50f" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 39521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:37.894201 22748 consensus_queue.cc:1035] T d7ca4423b910412aaee7f820c6bd3b70 P 1be4b5c65a3b4d60a195cbc4026d3ef7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f3554fb8dce49f1be8a97b9bcbf5994" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 44471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:37.896775 22757 mvcc.cc:205] Tried to move back new op lower bound from 7316163534410342400 to 7316163534228987904. Current Snapshot: MvccSnapshot[applied={T|T < 7316163534410342400}]
I20260808 07:05:37.898922 21991 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:37.899019 21991 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47332:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:37.899760 21991 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55ae8c07b20e4b6b8159e8f70b4138cd: Sending DeleteTablet for 3 replicas of tablet d7ca4423b910412aaee7f820c6bd3b70
I20260808 07:05:37.900146 22176 tablet_service.cc:1514] Processing DeleteTablet for tablet d7ca4423b910412aaee7f820c6bd3b70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:37 UTC) from {username='slave'} at 127.0.0.1:36564
I20260808 07:05:37.900133 22618 tablet_service.cc:1514] Processing DeleteTablet for tablet d7ca4423b910412aaee7f820c6bd3b70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:37 UTC) from {username='slave'} at 127.0.0.1:52468
I20260808 07:05:37.900339 22381 tablet_service.cc:1514] Processing DeleteTablet for tablet d7ca4423b910412aaee7f820c6bd3b70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:37 UTC) from {username='slave'} at 127.0.0.1:53534
I20260808 07:05:37.900394 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 22080
I20260808 07:05:37.900961 22766 tablet_replica.cc:330] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: stopping tablet replica
I20260808 07:05:37.901055 22766 raft_consensus.cc:2229] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:37.901149 22766 raft_consensus.cc:2258] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:37.901254 22767 tablet_replica.cc:330] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: stopping tablet replica
I20260808 07:05:37.901340 22767 raft_consensus.cc:2229] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:37.901422 22767 raft_consensus.cc:2258] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:37.903680 22767 ts_tablet_manager.cc:1905] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:37.903680 22766 ts_tablet_manager.cc:1905] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:37.905267 22767 ts_tablet_manager.cc:1918] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:37.905270 22766 ts_tablet_manager.cc:1918] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:37.905342 22766 log.cc:1196] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/d7ca4423b910412aaee7f820c6bd3b70
I20260808 07:05:37.905342 22767 log.cc:1196] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/d7ca4423b910412aaee7f820c6bd3b70
I20260808 07:05:37.905606 22767 ts_tablet_manager.cc:1939] T d7ca4423b910412aaee7f820c6bd3b70 P 7f3554fb8dce49f1be8a97b9bcbf5994: Deleting consensus metadata
I20260808 07:05:37.905614 22766 ts_tablet_manager.cc:1939] T d7ca4423b910412aaee7f820c6bd3b70 P e3412aebc42c4b6c8f8316f7f632b50f: Deleting consensus metadata
I20260808 07:05:37.905982 21968 catalog_manager.cc:4841] TS e3412aebc42c4b6c8f8316f7f632b50f (127.26.23.131:39521): tablet d7ca4423b910412aaee7f820c6bd3b70 (table test-table [id=cbea4e8273374cd3933f8852c45acfb4]) successfully deleted
I20260808 07:05:37.906080 21973 catalog_manager.cc:4841] TS 7f3554fb8dce49f1be8a97b9bcbf5994 (127.26.23.130:44471): tablet d7ca4423b910412aaee7f820c6bd3b70 (table test-table [id=cbea4e8273374cd3933f8852c45acfb4]) successfully deleted
W20260808 07:05:37.911685 21974 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:37115 (error 108)
I20260808 07:05:37.911933 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 22289
I20260808 07:05:37.914718 22727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:37.912040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:37115 (local address 127.0.0.1:36568)
0808 07:05:37.914620 (+ 2580us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:37.914680 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:37115: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2554}
W20260808 07:05:37.915907 21974 catalog_manager.cc:4584] TS 1be4b5c65a3b4d60a195cbc4026d3ef7 (127.26.23.129:37115): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d7ca4423b910412aaee7f820c6bd3b70: Network error: Client connection negotiation failed: client connection to 127.26.23.129:37115: connect: Connection refused (error 111)
I20260808 07:05:37.922219 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 22511
I20260808 07:05:37.929354 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 21943
2026-08-08T07:05:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (889 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:37 dist-test-slave-zj8q krb5kdc[22778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:37 dist-test-slave-zj8q krb5kdc[22778](info): set up 2 sockets
Aug 08 07:05:37 dist-test-slave-zj8q krb5kdc[22778](info): commencing operation
krb5kdc: starting...
W20260808 07:05:39.075116 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:05:39.190936 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43265
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:43265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:39.272025 22795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:39.272246 22795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:39.272267 22795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:39.273409 22795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:39.273454 22795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:39.273466 22795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:39.273478 22795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:39.273488 22795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:39.275009 22795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:43265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:39.275262 22795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:39.275472 22795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:39.280262 22808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.280273 22805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:39.280323 22795 server_base.cc:1034] running on GCE node
W20260808 07:05:39.280278 22803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:39.280740 22795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:39.281018 22795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:39.282234 22795 hybrid_clock.cc:648] HybridClock initialized: now 1786172739282216 us; error 30 us; skew 500 ppm
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:39.284749 22795 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:05:39.285190 22795 webserver.cc:460] Webserver started at http://127.26.23.190:33995/ using document root <none> and password file <none>
I20260808 07:05:39.285399 22795 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:39.285449 22795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:39.285593 22795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:39.286670 22795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "2e6dd24e6f804e1eb5d18fde29c711c1"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "3d2239edd41b1438702ec9ae1024766e"
server_key_iv: "23396e098ef1514016a2bbdea74500e0"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.287014 22795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "2e6dd24e6f804e1eb5d18fde29c711c1"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "3d2239edd41b1438702ec9ae1024766e"
server_key_iv: "23396e098ef1514016a2bbdea74500e0"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.288307 22795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:39.288996 22817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.289155 22795 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:39.289244 22795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "2e6dd24e6f804e1eb5d18fde29c711c1"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "3d2239edd41b1438702ec9ae1024766e"
server_key_iv: "23396e098ef1514016a2bbdea74500e0"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.289304 22795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:39.299273 22795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:39.301326 22795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:39.301460 22795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:39.305392 22795 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:43265
I20260808 07:05:39.305445 22901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:43265 every 8 connection(s)
I20260808 07:05:39.305770 22795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:39.306670 22902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:39.308898 22902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1: Bootstrap starting.
I20260808 07:05:39.309459 22902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:39.309728 22902 log.cc:824] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:39.310417 22902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1: No bootstrap required, opened a new log
I20260808 07:05:39.312032 22902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43265 } }
I20260808 07:05:39.312170 22902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:39.312192 22902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e6dd24e6f804e1eb5d18fde29c711c1, State: Initialized, Role: FOLLOWER
I20260808 07:05:39.312327 22902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43265 } }
I20260808 07:05:39.312392 22902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:39.312414 22902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:39.312460 22902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:39.312963 22902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43265 } }
I20260808 07:05:39.313056 22902 leader_election.cc:302] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e6dd24e6f804e1eb5d18fde29c711c1; no voters:
I20260808 07:05:39.313225 22902 leader_election.cc:288] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:39.313274 22908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:39.313426 22908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [term 1 LEADER]: Becoming Leader. State: Replica: 2e6dd24e6f804e1eb5d18fde29c711c1, State: Running, Role: LEADER
I20260808 07:05:39.313462 22902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:39.313513 22908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43265 } }
I20260808 07:05:39.313879 22911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e6dd24e6f804e1eb5d18fde29c711c1. Latest consensus state: current_term: 1 leader_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43265 } } }
I20260808 07:05:39.313963 22911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:39.313992 22910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e6dd24e6f804e1eb5d18fde29c711c1" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43265 } } }
I20260808 07:05:39.314040 22910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:39.314373 22930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:39.314983 22930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:39.315578 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 22795
I20260808 07:05:39.315696 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:39.315871 26718 external_mini_cluster.cc:1428] Setting key 170813c7fe313e125a04e3843a0e5c44
I20260808 07:05:39.316679 22930 catalog_manager.cc:1347] Generated new cluster ID: a4ca12319878480b80b4e0516788a611
I20260808 07:05:39.316733 22930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:39.327716 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.316327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38106 (local address 127.26.23.190:43265)
0808 07:05:39.316733 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.316742 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.316775 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:05:39.316889 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.316895 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.316948 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.317074 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:39.318057 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.319484 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.320567 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.321169 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.321262 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.324084 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:39.324088 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:39.324089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:39.324112 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:39.325994 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.326422 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.326425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.326426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.326526 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.326712 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.326713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.326713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.327002 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:39.327143 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.327243 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.327479 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":78,"threads_started":1}
I20260808 07:05:39.332710 22930 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:39.333190 22930 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:39.343379 22930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1: Generated new TSK 0
I20260808 07:05:39.343521 22930 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:05:39.375156 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43265
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:39.468070 22954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:39.468259 22954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:39.468281 22954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:39.469379 22954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:39.469419 22954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:39.469445 22954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:39.470922 22954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:39.471145 22954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:39.471354 22954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:39.476236 22962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.476150 22964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.476151 22967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:39.476455 22954 server_base.cc:1034] running on GCE node
I20260808 07:05:39.476645 22954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:39.476894 22954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:39.478047 22954 hybrid_clock.cc:648] HybridClock initialized: now 1786172739478034 us; error 30 us; skew 500 ppm
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:39.480556 22954 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:05:39.481003 22954 webserver.cc:460] Webserver started at http://127.26.23.129:37089/ using document root <none> and password file <none>
I20260808 07:05:39.481220 22954 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:39.481266 22954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:39.481381 22954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:39.482402 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "0eef05b12b1a4533bdf8f20921a649bf"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "c86076335b8d028c4d313bf2d57085dd"
server_key_iv: "859ecbcb3ffda99b0f98bbd38fb070cb"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.482714 22954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "0eef05b12b1a4533bdf8f20921a649bf"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "c86076335b8d028c4d313bf2d57085dd"
server_key_iv: "859ecbcb3ffda99b0f98bbd38fb070cb"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.483915 22954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:39.484555 22976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.484725 22954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:39.484817 22954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "0eef05b12b1a4533bdf8f20921a649bf"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "c86076335b8d028c4d313bf2d57085dd"
server_key_iv: "859ecbcb3ffda99b0f98bbd38fb070cb"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.484891 22954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:39.497351 22954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:39.499320 22954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:39.499444 22954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:39.499642 22954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:39.499913 22954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:39.499945 22954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.499966 22954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:39.499989 22954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.505570 22954 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:43233
I20260808 07:05:39.505631 23151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:43233 every 8 connection(s)
I20260808 07:05:39.505906 22954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:39.510726 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 22954
I20260808 07:05:39.510830 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:39.510998 26718 external_mini_cluster.cc:1428] Setting key e24a5c1971a728a6671b11d8ff5aaff7
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:39.514729 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.506567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:41451 (local address 127.26.23.190:43265)
0808 07:05:39.506648 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.506650 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.506823 (+ 173us) server_negotiation.cc:407] Connection header received
0808 07:05:39.507275 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.507276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.507289 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.507340 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:39.508212 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.508712 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.509669 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.509855 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.509900 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.512120 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:39.512121 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:39.512122 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:39.512129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:39.513331 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.513813 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.513814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.513815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.513881 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.514099 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.514100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.514100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.514247 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:39.514312 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.514549 (+ 237us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.514647 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:39.514791 23154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.506534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43265 (local address 127.26.23.129:41451)
0808 07:05:39.506706 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.506745 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.507201 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.507397 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.507401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.507941 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:39.508142 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.508147 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.508774 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.508775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.509592 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.509595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.509913 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.509914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.510021 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.510467 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:39.510475 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:39.512032 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:39.513418 (+ 1386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:39.513427 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:39.513430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:39.513748 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:39.513944 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:39.513945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:39.513945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:39.514047 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:39.514305 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:39.514311 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:39.514428 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.514508 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.514628 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
I20260808 07:05:39.515221 23152 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43265
I20260808 07:05:39.515308 23152 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:39.515470 23152 heartbeater.cc:511] Master 127.26.23.190:43265 requested a full tablet report, sending...
I20260808 07:05:39.515991 22841 ts_manager.cc:194] Registered new tserver with Master: 0eef05b12b1a4533bdf8f20921a649bf (127.26.23.129:43233)
I20260808 07:05:39.516865 22841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:41451
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:05:39.537087 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43265
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:39.618712 23157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:39.618921 23157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:39.618952 23157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:39.620067 23157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:39.620108 23157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:39.620143 23157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:39.621541 23157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:39.621784 23157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:39.622000 23157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:39.626952 23164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.626999 23163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.626964 23167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:39.627117 23157 server_base.cc:1034] running on GCE node
I20260808 07:05:39.627362 23157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:39.627595 23157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:39.628741 23157 hybrid_clock.cc:648] HybridClock initialized: now 1786172739628723 us; error 28 us; skew 500 ppm
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:39.631307 23157 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:05:39.631783 23157 webserver.cc:460] Webserver started at http://127.26.23.130:35393/ using document root <none> and password file <none>
I20260808 07:05:39.631994 23157 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:39.632043 23157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:39.632180 23157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:39.633242 23157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "7ffe9223556742978634941824fd0b92"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "1798a85c8e27668e9904c04b4afdabf7"
server_key_iv: "060693134db47a602828dbd53c383907"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.633585 23157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "7ffe9223556742978634941824fd0b92"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "1798a85c8e27668e9904c04b4afdabf7"
server_key_iv: "060693134db47a602828dbd53c383907"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.634930 23157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:39.635654 23177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.635814 23157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:39.635902 23157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "7ffe9223556742978634941824fd0b92"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "1798a85c8e27668e9904c04b4afdabf7"
server_key_iv: "060693134db47a602828dbd53c383907"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.635969 23157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:39.648206 23157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:39.649899 23157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:39.650027 23157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:39.650301 23157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:39.650584 23157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:39.650616 23157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.650643 23157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:39.650662 23157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.656332 23157 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:43243
I20260808 07:05:39.656392 23372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:43243 every 8 connection(s)
I20260808 07:05:39.656677 23157 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:39.662226 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 23157
I20260808 07:05:39.662318 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:39.662493 26718 external_mini_cluster.cc:1428] Setting key 3db28276a40d4ca4b32eea6160d781dd
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:39.665735 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.657378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:47927 (local address 127.26.23.190:43265)
0808 07:05:39.657443 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.657446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.657623 (+ 177us) server_negotiation.cc:407] Connection header received
0808 07:05:39.658139 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.658140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.658178 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.658243 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:39.659151 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.659659 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.660689 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.660925 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.660985 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.663183 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:39.663185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:39.663185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:39.663193 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:39.664467 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.664837 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.664838 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.664839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.664891 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.665110 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.665111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.665112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.665222 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:39.665281 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.665548 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.665645 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:05:39.665876 23376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.657323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43265 (local address 127.26.23.130:47927)
0808 07:05:39.657511 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.657549 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.658012 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.658300 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.658303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.658869 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:39.659074 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.659080 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.659766 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.659768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.660596 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.660599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.661024 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.661026 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.661151 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.661585 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:39.661592 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:39.663055 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:39.664544 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:39.664551 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:39.664553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:39.664769 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:39.664947 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:39.664947 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:39.664948 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:39.665050 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:39.665277 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:39.665284 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:39.665419 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.665504 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.665669 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":82,"threads_started":1}
I20260808 07:05:39.666337 23373 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43265
I20260808 07:05:39.666438 23373 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:39.666628 23373 heartbeater.cc:511] Master 127.26.23.190:43265 requested a full tablet report, sending...
I20260808 07:05:39.666975 22841 ts_manager.cc:194] Registered new tserver with Master: 7ffe9223556742978634941824fd0b92 (127.26.23.130:43243)
I20260808 07:05:39.667351 22841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:47927
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:05:39.689091 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43265
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:39.768683 23379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:39.768862 23379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:39.768882 23379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:39.769960 23379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:39.769999 23379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:39.770025 23379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:39.771458 23379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:43265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:39.771692 23379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:39.771905 23379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:39.776654 23387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.776909 23385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:39.776952 23391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:39.776935 23379 server_base.cc:1034] running on GCE node
I20260808 07:05:39.777166 23379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:39.777380 23379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:39.778503 23379 hybrid_clock.cc:648] HybridClock initialized: now 1786172739778491 us; error 31 us; skew 500 ppm
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:39.780880 23379 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:05:39.781330 23379 webserver.cc:460] Webserver started at http://127.26.23.131:34839/ using document root <none> and password file <none>
I20260808 07:05:39.781549 23379 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:39.781597 23379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:39.781723 23379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:39.782768 23379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "392e4635dca64c1db06c49f2666fe2f6"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "7762a35184239385f02787b0eb7621b7"
server_key_iv: "c35cee98276864caa557fa1fc37543c4"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.783087 23379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "392e4635dca64c1db06c49f2666fe2f6"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "7762a35184239385f02787b0eb7621b7"
server_key_iv: "c35cee98276864caa557fa1fc37543c4"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.784281 23379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:39.784933 23405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.785087 23379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:39.785180 23379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "392e4635dca64c1db06c49f2666fe2f6"
format_stamp: "Formatted at 2026-08-08 07:05:39 on dist-test-slave-zj8q"
server_key: "7762a35184239385f02787b0eb7621b7"
server_key_iv: "c35cee98276864caa557fa1fc37543c4"
server_key_version: "encryptionkey@0"
I20260808 07:05:39.785239 23379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:39.824752 23379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:39.826959 23379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:39.827100 23379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:39.827333 23379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:39.827718 23379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:39.827766 23379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.827796 23379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:39.827821 23379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:39.833376 23379 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:38895
I20260808 07:05:39.833431 23575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:38895 every 8 connection(s)
I20260808 07:05:39.833722 23379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:39.834311 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 23379
I20260808 07:05:39.834417 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:39.834616 26718 external_mini_cluster.cc:1428] Setting key 5d48897bae09b9afda0dad9ac15c0b9d
Aug 08 07:05:39 dist-test-slave-zj8q krb5kdc[22778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172739, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:39.842442 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.834434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:51565 (local address 127.26.23.190:43265)
0808 07:05:39.834482 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.834484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.834701 (+ 217us) server_negotiation.cc:407] Connection header received
0808 07:05:39.835254 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.835256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.835270 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.835322 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:39.836242 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.836735 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.837698 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.837888 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.837952 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.840062 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:39.840064 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:39.840064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:39.840073 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:39.841169 (+ 1096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.841531 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.841532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.841533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.841590 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.841807 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.841808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.841808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.841924 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:39.841979 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.842272 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.842352 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:05:39.842602 23582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.834426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:43265 (local address 127.26.23.131:51565)
0808 07:05:39.834580 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.834622 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.835152 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.835389 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.835394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.835953 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:39.836153 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.836159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.836815 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.836816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.837621 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.837624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.837955 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.837956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.838094 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.838589 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:39.838599 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:39.839980 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:39.841241 (+ 1261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:39.841249 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:39.841251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:39.841465 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:39.841646 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:39.841646 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:39.841647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:39.841750 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:39.841980 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:39.841986 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:39.842120 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.842246 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.842398 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260808 07:05:39.843011 23577 heartbeater.cc:347] Connected to a master server at 127.26.23.190:43265
I20260808 07:05:39.843111 23577 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:39.843291 23577 heartbeater.cc:511] Master 127.26.23.190:43265 requested a full tablet report, sending...
I20260808 07:05:39.843699 22841 ts_manager.cc:194] Registered new tserver with Master: 392e4635dca64c1db06c49f2666fe2f6 (127.26.23.131:38895)
I20260808 07:05:39.844058 22841 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:51565
I20260808 07:05:39.846099 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:39.852447 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.847343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38110 (local address 127.26.23.190:43265)
0808 07:05:39.847404 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.847406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.847510 (+ 104us) server_negotiation.cc:407] Connection header received
0808 07:05:39.847553 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.847553 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.847561 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.847604 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:39.848067 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.848526 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.849167 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.849337 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.849380 (+ 43us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.850516 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:39.850517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:39.850518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:39.850522 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:39.851511 (+ 989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.851841 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.851842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.851842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.851899 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:39.852037 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:39.852037 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:39.852037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:39.852184 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:39.852263 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.852342 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.852387 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:05:39.853888 22841 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:39.855449 22841 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:39.861491 23602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.857573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:38895 (local address 127.0.0.1:43190)
0808 07:05:39.857889 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.857927 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.857998 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.858293 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.858294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.858295 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:39.858332 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.858333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.859225 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.859226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.860380 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.860383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.861229 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.861229 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.861300 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.861309 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.861363 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.861418 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":62,"threads_started":1}
I20260808 07:05:39.861502 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.857642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43190 (local address 127.26.23.131:38895)
0808 07:05:39.857797 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.857802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.857986 (+ 184us) server_negotiation.cc:407] Connection header received
0808 07:05:39.858127 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.858130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.858145 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.858214 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:39.858414 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.859138 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.860461 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.861081 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.861123 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.861174 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.861387 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.861424 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260808 07:05:39.861749 23598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.857767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:43233 (local address 127.0.0.1:45760)
0808 07:05:39.858105 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.858114 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.858171 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.858458 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.858459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.858461 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:39.858513 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.858514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.859804 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.859805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.860647 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.860649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.861537 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.861538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.861598 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.861602 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.861643 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.861678 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":77,"threads_started":1}
I20260808 07:05:39.861821 23597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.857610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:43243 (local address 127.0.0.1:45984)
0808 07:05:39.857923 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.857933 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.858001 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.858255 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.858258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.858260 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:39.858322 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.858324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.859706 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.859707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.860730 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.860733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.861598 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.861599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.861650 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.861653 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.861702 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.861733 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":65,"threads_started":1}
I20260808 07:05:39.861959 23600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.857754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45984 (local address 127.26.23.130:43243)
0808 07:05:39.857918 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.857922 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.858010 (+ 88us) server_negotiation.cc:407] Connection header received
0808 07:05:39.858087 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.858089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.858136 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.858248 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:39.858513 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.859606 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.860795 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.861460 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.861515 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.861568 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.861734 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.861775 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260808 07:05:39.862038 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.857980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45760 (local address 127.26.23.129:43233)
0808 07:05:39.858301 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.858304 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.858314 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:39.858351 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.858353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.858367 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.858587 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:39.858702 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.859715 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.860726 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.861435 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.861827 (+ 392us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.861896 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.861921 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.861959 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":102,"threads_started":1}
I20260808 07:05:39.862665 23254 tablet_service.cc:1467] Processing CreateTablet for tablet d38e0ffa1231488e9b99301c5d849580 (DEFAULT_TABLE table=test-table [id=b53837b47a7c4a959e0dd8f5439275cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:39.862738 23048 tablet_service.cc:1467] Processing CreateTablet for tablet d38e0ffa1231488e9b99301c5d849580 (DEFAULT_TABLE table=test-table [id=b53837b47a7c4a959e0dd8f5439275cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:39.862855 23477 tablet_service.cc:1467] Processing CreateTablet for tablet d38e0ffa1231488e9b99301c5d849580 (DEFAULT_TABLE table=test-table [id=b53837b47a7c4a959e0dd8f5439275cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:39.863026 23254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d38e0ffa1231488e9b99301c5d849580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:39.863062 23048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d38e0ffa1231488e9b99301c5d849580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:39.863127 23477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d38e0ffa1231488e9b99301c5d849580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:39.865363 23606 tablet_bootstrap.cc:492] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf: Bootstrap starting.
I20260808 07:05:39.866232 23606 tablet_bootstrap.cc:654] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:39.866248 23608 tablet_bootstrap.cc:492] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Bootstrap starting.
I20260808 07:05:39.866804 23606 log.cc:824] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:39.866873 23608 tablet_bootstrap.cc:654] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:39.867190 23607 tablet_bootstrap.cc:492] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Bootstrap starting.
I20260808 07:05:39.867403 23608 log.cc:824] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:39.867772 23607 tablet_bootstrap.cc:654] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:39.868147 23608 tablet_bootstrap.cc:492] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: No bootstrap required, opened a new log
I20260808 07:05:39.868219 23608 ts_tablet_manager.cc:1397] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:39.868268 23607 log.cc:824] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:39.868789 23606 tablet_bootstrap.cc:492] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf: No bootstrap required, opened a new log
I20260808 07:05:39.868856 23606 ts_tablet_manager.cc:1397] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260808 07:05:39.868912 23607 tablet_bootstrap.cc:492] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: No bootstrap required, opened a new log
I20260808 07:05:39.868978 23607 ts_tablet_manager.cc:1397] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:39.870321 23608 raft_consensus.cc:348] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.870406 23607 raft_consensus.cc:348] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.870497 23608 raft_consensus.cc:374] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:39.870534 23608 raft_consensus.cc:729] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 392e4635dca64c1db06c49f2666fe2f6, State: Initialized, Role: FOLLOWER
I20260808 07:05:39.870536 23607 raft_consensus.cc:374] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:39.870571 23607 raft_consensus.cc:729] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffe9223556742978634941824fd0b92, State: Initialized, Role: FOLLOWER
I20260808 07:05:39.870668 23608 consensus_queue.cc:260] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.870689 23607 consensus_queue.cc:260] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.870942 23608 ts_tablet_manager.cc:1428] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 07:05:39.870954 23373 heartbeater.cc:503] Master 127.26.23.190:43265 was elected leader, sending a full tablet report...
I20260808 07:05:39.870859 23606 raft_consensus.cc:348] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.871021 23606 raft_consensus.cc:374] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:39.871060 23577 heartbeater.cc:503] Master 127.26.23.190:43265 was elected leader, sending a full tablet report...
I20260808 07:05:39.871076 23606 raft_consensus.cc:729] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0eef05b12b1a4533bdf8f20921a649bf, State: Initialized, Role: FOLLOWER
I20260808 07:05:39.871192 23607 ts_tablet_manager.cc:1428] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:05:39.871210 23606 consensus_queue.cc:260] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.871619 23152 heartbeater.cc:503] Master 127.26.23.190:43265 was elected leader, sending a full tablet report...
I20260808 07:05:39.871817 23606 ts_tablet_manager.cc:1428] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
W20260808 07:05:39.907241 23375 tablet.cc:2369] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:39.945717 23624 raft_consensus.cc:482] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:39.945852 23624 raft_consensus.cc:504] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.946278 23624 leader_election.cc:288] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffe9223556742978634941824fd0b92 (127.26.23.130:43243), 392e4635dca64c1db06c49f2666fe2f6 (127.26.23.131:38895)
I20260808 07:05:39.949288 23599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.946549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:58071 (local address 127.26.23.131:38895)
0808 07:05:39.946595 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.946597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.946606 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:39.946634 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.946635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.946645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.946701 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:39.946871 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.947479 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.948444 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.948955 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.949016 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.949026 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.949176 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.949221 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:05:39.949283 23154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.946459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:38895 (local address 127.26.23.129:58071)
0808 07:05:39.946515 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.946526 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.946569 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.946713 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.946715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.946717 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:39.946787 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.946790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.947548 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.947549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.948354 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.948357 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.949024 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.949025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.949105 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.949108 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.949160 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.949199 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 07:05:39.949327 23600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.946547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:56087 (local address 127.26.23.130:43243)
0808 07:05:39.946593 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.946594 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.946772 (+ 178us) server_negotiation.cc:407] Connection header received
0808 07:05:39.946802 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.946803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.946813 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.946866 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:39.946998 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.947606 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.948510 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.949017 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.949055 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.949062 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.949232 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.949270 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:05:39.949349 23626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.946478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:43243 (local address 127.26.23.129:56087)
0808 07:05:39.946701 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:39.946711 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:39.946762 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:39.946872 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:39.946873 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:39.946874 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:39.946941 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.946943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.947688 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.947689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.948405 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:39.948407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.949092 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.949093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:39.949165 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.949167 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:39.949210 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 07:05:39.949239 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":126,"threads_started":1}
I20260808 07:05:39.949651 23506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38e0ffa1231488e9b99301c5d849580" candidate_uuid: "0eef05b12b1a4533bdf8f20921a649bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392e4635dca64c1db06c49f2666fe2f6" is_pre_election: true
I20260808 07:05:39.949692 23287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38e0ffa1231488e9b99301c5d849580" candidate_uuid: "0eef05b12b1a4533bdf8f20921a649bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffe9223556742978634941824fd0b92" is_pre_election: true
I20260808 07:05:39.949811 23506 raft_consensus.cc:2454] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eef05b12b1a4533bdf8f20921a649bf in term 0.
I20260808 07:05:39.949831 23287 raft_consensus.cc:2454] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0eef05b12b1a4533bdf8f20921a649bf in term 0.
I20260808 07:05:39.950044 22977 leader_election.cc:302] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0eef05b12b1a4533bdf8f20921a649bf, 392e4635dca64c1db06c49f2666fe2f6, 7ffe9223556742978634941824fd0b92; no voters:
I20260808 07:05:39.950209 23624 raft_consensus.cc:2781] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:39.950285 23624 raft_consensus.cc:482] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:39.950311 23624 raft_consensus.cc:3037] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:39.951061 23624 raft_consensus.cc:504] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.951185 23624 leader_election.cc:288] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [CANDIDATE]: Term 1 election: Requested vote from peers 7ffe9223556742978634941824fd0b92 (127.26.23.130:43243), 392e4635dca64c1db06c49f2666fe2f6 (127.26.23.131:38895)
I20260808 07:05:39.951324 23506 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38e0ffa1231488e9b99301c5d849580" candidate_uuid: "0eef05b12b1a4533bdf8f20921a649bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "392e4635dca64c1db06c49f2666fe2f6"
I20260808 07:05:39.951388 23287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d38e0ffa1231488e9b99301c5d849580" candidate_uuid: "0eef05b12b1a4533bdf8f20921a649bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffe9223556742978634941824fd0b92"
I20260808 07:05:39.951403 23506 raft_consensus.cc:3037] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:39.951470 23287 raft_consensus.cc:3037] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:39.952111 23506 raft_consensus.cc:2454] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eef05b12b1a4533bdf8f20921a649bf in term 1.
I20260808 07:05:39.952235 23287 raft_consensus.cc:2454] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0eef05b12b1a4533bdf8f20921a649bf in term 1.
I20260808 07:05:39.952317 22981 leader_election.cc:302] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0eef05b12b1a4533bdf8f20921a649bf, 392e4635dca64c1db06c49f2666fe2f6; no voters:
I20260808 07:05:39.952409 23624 raft_consensus.cc:2781] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:39.952576 23624 raft_consensus.cc:686] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [term 1 LEADER]: Becoming Leader. State: Replica: 0eef05b12b1a4533bdf8f20921a649bf, State: Running, Role: LEADER
I20260808 07:05:39.952673 23624 consensus_queue.cc:237] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } }
I20260808 07:05:39.953486 22841 catalog_manager.cc:5495] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0eef05b12b1a4533bdf8f20921a649bf (127.26.23.129). New cstate: current_term: 1 leader_uuid: "0eef05b12b1a4533bdf8f20921a649bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0eef05b12b1a4533bdf8f20921a649bf" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43233 } health_report { overall_health: HEALTHY } } }
I20260808 07:05:39.976325 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:39.974092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45764 (local address 127.26.23.129:43233)
0808 07:05:39.974166 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:39.974168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:39.974178 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:39.974264 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:39.974265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:39.974286 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:39.974347 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:39.974473 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.974972 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.975694 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:39.975872 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:39.975914 (+ 42us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:39.976044 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:39.976133 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:39.976200 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:39.976218 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 07:05:39.976227 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 07:05:39.978065 23506 raft_consensus.cc:1261] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 1 FOLLOWER]: Refusing update from remote peer 0eef05b12b1a4533bdf8f20921a649bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:39.978071 23287 raft_consensus.cc:1261] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 1 FOLLOWER]: Refusing update from remote peer 0eef05b12b1a4533bdf8f20921a649bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:39.978411 23627 consensus_queue.cc:1035] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffe9223556742978634941824fd0b92" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 43243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:39.978535 23624 consensus_queue.cc:1035] T d38e0ffa1231488e9b99301c5d849580 P 0eef05b12b1a4533bdf8f20921a649bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "392e4635dca64c1db06c49f2666fe2f6" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:39.982980 22841 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:39.983062 22841 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:39.983729 22841 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2e6dd24e6f804e1eb5d18fde29c711c1: Sending DeleteTablet for 3 replicas of tablet d38e0ffa1231488e9b99301c5d849580
I20260808 07:05:39.984023 23254 tablet_service.cc:1514] Processing DeleteTablet for tablet d38e0ffa1231488e9b99301c5d849580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:39 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:45984
I20260808 07:05:39.984107 23048 tablet_service.cc:1514] Processing DeleteTablet for tablet d38e0ffa1231488e9b99301c5d849580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:39 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:45760
I20260808 07:05:39.984091 23477 tablet_service.cc:1514] Processing DeleteTablet for tablet d38e0ffa1231488e9b99301c5d849580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:39 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:43190
I20260808 07:05:39.984320 23645 tablet_replica.cc:330] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: stopping tablet replica
I20260808 07:05:39.984423 23645 raft_consensus.cc:2229] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:39.984423 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 22954
I20260808 07:05:39.984994 23645 raft_consensus.cc:2258] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:39.985440 23645 ts_tablet_manager.cc:1905] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:39.986961 23645 ts_tablet_manager.cc:1918] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:39.987071 23645 log.cc:1196] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/d38e0ffa1231488e9b99301c5d849580
I20260808 07:05:39.987416 23645 ts_tablet_manager.cc:1939] T d38e0ffa1231488e9b99301c5d849580 P 392e4635dca64c1db06c49f2666fe2f6: Deleting consensus metadata
I20260808 07:05:39.987852 22823 catalog_manager.cc:4841] TS 392e4635dca64c1db06c49f2666fe2f6 (127.26.23.131:38895): tablet d38e0ffa1231488e9b99301c5d849580 (table test-table [id=b53837b47a7c4a959e0dd8f5439275cd]) successfully deleted
I20260808 07:05:39.995342 23644 tablet_replica.cc:330] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: stopping tablet replica
I20260808 07:05:39.995479 23644 raft_consensus.cc:2229] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:39.995582 23644 raft_consensus.cc:2258] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:39.998728 23644 ts_tablet_manager.cc:1905] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:40.000382 23644 ts_tablet_manager.cc:1918] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:40.000460 23644 log.cc:1196] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/d38e0ffa1231488e9b99301c5d849580
I20260808 07:05:40.000722 23644 ts_tablet_manager.cc:1939] T d38e0ffa1231488e9b99301c5d849580 P 7ffe9223556742978634941824fd0b92: Deleting consensus metadata
I20260808 07:05:40.001130 22818 catalog_manager.cc:4841] TS 7ffe9223556742978634941824fd0b92 (127.26.23.130:43243): tablet d38e0ffa1231488e9b99301c5d849580 (table test-table [id=b53837b47a7c4a959e0dd8f5439275cd]) successfully deleted
W20260808 07:05:40.003293 22823 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:43233 (error 108)
I20260808 07:05:40.003552 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 23157
I20260808 07:05:40.005430 23602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.003661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:43233 (local address 127.0.0.1:45772)
0808 07:05:40.005352 (+ 1691us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.005397 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:43233: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1663}
W20260808 07:05:40.007524 22823 catalog_manager.cc:4584] TS 0eef05b12b1a4533bdf8f20921a649bf (127.26.23.129:43233): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d38e0ffa1231488e9b99301c5d849580: Network error: Client connection negotiation failed: client connection to 127.26.23.129:43233: connect: Connection refused (error 111)
I20260808 07:05:40.016304 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 23379
I20260808 07:05:40.037782 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 22795
2026-08-08T07:05:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2113 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T07:05:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:40Z Disabled control of system clock
I20260808 07:05:40.072956 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40815
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:40815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:40.153940 23662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:40.154186 23662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:40.154208 23662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:40.155462 23662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:40.155511 23662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:40.155524 23662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:40.155534 23662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:40.155553 23662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:40.156891 23662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:40815
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:40815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:40.157124 23662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:40.157405 23662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:40.162062 23670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.162070 23674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.162081 23671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:40.162341 23662 server_base.cc:1034] running on GCE node
I20260808 07:05:40.162603 23662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:40.162876 23662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:40.164019 23662 hybrid_clock.cc:648] HybridClock initialized: now 1786172740164004 us; error 31 us; skew 500 ppm
I20260808 07:05:40.167969 23662 webserver.cc:460] Webserver started at http://127.26.23.190:36589/ using document root <none> and password file <none>
I20260808 07:05:40.168196 23662 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:40.168244 23662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:40.168354 23662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:40.169394 23662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "b483b47e6d904cbd8796f9f57e562f75"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "77ab54e824609471e2976f8bb7c2f5d4"
server_key_iv: "618628de9d6982bd2b88ade942b4bbd6"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.169726 23662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "b483b47e6d904cbd8796f9f57e562f75"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "77ab54e824609471e2976f8bb7c2f5d4"
server_key_iv: "618628de9d6982bd2b88ade942b4bbd6"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.171025 23662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:40.171759 23683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.171926 23662 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:40.172012 23662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "b483b47e6d904cbd8796f9f57e562f75"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "77ab54e824609471e2976f8bb7c2f5d4"
server_key_iv: "618628de9d6982bd2b88ade942b4bbd6"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.172072 23662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:40.182438 23662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:40.182695 23662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:40.182817 23662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:40.186617 23662 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:40815
I20260808 07:05:40.186657 23759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:40815 every 8 connection(s)
I20260808 07:05:40.186956 23662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:40.187189 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 23662
I20260808 07:05:40.187325 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:40.187510 26718 external_mini_cluster.cc:1428] Setting key 5d817ec20e4abe5bc8bd45a19de8dffe
I20260808 07:05:40.188081 23760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:40.190739 23760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75: Bootstrap starting.
I20260808 07:05:40.191344 23760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:40.191614 23760 log.cc:824] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:40.192436 23760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75: No bootstrap required, opened a new log
I20260808 07:05:40.192726 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.188001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56612 (local address 127.26.23.190:40815)
0808 07:05:40.188264 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.188272 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.188301 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:05:40.188735 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.188741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.188801 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.188925 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:40.189138 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.190027 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.190847 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.191259 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.191368 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.192005 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:40.192009 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:40.192010 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:40.192186 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:40.192228 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:40.192245 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:40.192317 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.192385 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.192464 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":111,"threads_started":1}
I20260808 07:05:40.194265 23760 raft_consensus.cc:348] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b483b47e6d904cbd8796f9f57e562f75" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40815 } }
I20260808 07:05:40.194425 23760 raft_consensus.cc:374] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:40.194451 23760 raft_consensus.cc:729] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b483b47e6d904cbd8796f9f57e562f75, State: Initialized, Role: FOLLOWER
I20260808 07:05:40.194547 23760 consensus_queue.cc:260] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b483b47e6d904cbd8796f9f57e562f75" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40815 } }
I20260808 07:05:40.194617 23760 raft_consensus.cc:388] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:40.194643 23760 raft_consensus.cc:482] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:40.194689 23760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:40.195217 23760 raft_consensus.cc:504] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b483b47e6d904cbd8796f9f57e562f75" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40815 } }
I20260808 07:05:40.195312 23760 leader_election.cc:302] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b483b47e6d904cbd8796f9f57e562f75; no voters:
I20260808 07:05:40.195474 23760 leader_election.cc:288] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:40.195537 23767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:40.195701 23767 raft_consensus.cc:686] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [term 1 LEADER]: Becoming Leader. State: Replica: b483b47e6d904cbd8796f9f57e562f75, State: Running, Role: LEADER
I20260808 07:05:40.195719 23760 sys_catalog.cc:564] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:40.195801 23767 consensus_queue.cc:237] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b483b47e6d904cbd8796f9f57e562f75" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40815 } }
I20260808 07:05:40.196197 23769 sys_catalog.cc:455] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b483b47e6d904cbd8796f9f57e562f75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b483b47e6d904cbd8796f9f57e562f75" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40815 } } }
I20260808 07:05:40.196319 23769 sys_catalog.cc:458] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:40.196178 23770 sys_catalog.cc:455] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b483b47e6d904cbd8796f9f57e562f75. Latest consensus state: current_term: 1 leader_uuid: "b483b47e6d904cbd8796f9f57e562f75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b483b47e6d904cbd8796f9f57e562f75" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 40815 } } }
I20260808 07:05:40.196514 23770 sys_catalog.cc:458] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:40.196527 23779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:40.197111 23779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:40.198426 23779 catalog_manager.cc:1347] Generated new cluster ID: 5a342507a8324497825208cc72cd15e7
I20260808 07:05:40.198468 23779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:40.210304 23779 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:40.210968 23779 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:40.219002 23779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75: Generated new TSK 0
I20260808 07:05:40.219182 23779 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:40.224804 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40815
--builtin_ntp_servers=127.26.23.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:40.307075 23792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:40.307272 23792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:40.307303 23792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:40.308478 23792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:40.308522 23792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:40.308562 23792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:40.309871 23792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:40.310112 23792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:40.310410 23792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:40.315258 23815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.315265 23806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.315359 23812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:40.315852 23792 server_base.cc:1034] running on GCE node
I20260808 07:05:40.316016 23792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:40.316229 23792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:40.317395 23792 hybrid_clock.cc:648] HybridClock initialized: now 1786172740317379 us; error 27 us; skew 500 ppm
I20260808 07:05:40.318593 23792 webserver.cc:460] Webserver started at http://127.26.23.129:41505/ using document root <none> and password file <none>
I20260808 07:05:40.318822 23792 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:40.318872 23792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:40.318997 23792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:40.320056 23792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "6527afe58c8d4c768a46c76e41e6b16e"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "39464734e53d419fc9d5e80a6a26b3ca"
server_key_iv: "96d25b7c8382f5d9c4221d4eced6fe65"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.320382 23792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "6527afe58c8d4c768a46c76e41e6b16e"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "39464734e53d419fc9d5e80a6a26b3ca"
server_key_iv: "96d25b7c8382f5d9c4221d4eced6fe65"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.321626 23792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:40.322310 23824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.322499 23792 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:40.322593 23792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "6527afe58c8d4c768a46c76e41e6b16e"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "39464734e53d419fc9d5e80a6a26b3ca"
server_key_iv: "96d25b7c8382f5d9c4221d4eced6fe65"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.322660 23792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:40.337318 23792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:40.337574 23792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:40.337697 23792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:40.337885 23792 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:40.338220 23792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:40.338256 23792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.338284 23792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:40.338307 23792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.343660 23792 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:44967
I20260808 07:05:40.343719 24010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:44967 every 8 connection(s)
I20260808 07:05:40.343998 23792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:40.348882 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.344692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:48177 (local address 127.26.23.190:40815)
0808 07:05:40.344745 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.344747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.344954 (+ 207us) server_negotiation.cc:407] Connection header received
0808 07:05:40.345450 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.345451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.345467 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.345534 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:40.346218 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.346715 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.347651 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.347849 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.347903 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.348603 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:40.348604 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:40.348605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:40.348609 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:40.348623 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:40.348628 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:40.348670 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.348759 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.348802 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 07:05:40.349043 24015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.344679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40815 (local address 127.26.23.129:48177)
0808 07:05:40.344843 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.344876 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.345354 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.345605 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.345608 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.345617 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:40.346109 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.346115 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.346799 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.346800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.347571 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.347573 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.347920 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.347921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.348041 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.348470 (+ 429us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:40.348471 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:40.348498 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:40.348518 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:40.348693 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:40.348698 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:40.348700 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.348756 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.348857 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260808 07:05:40.349484 24012 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40815
I20260808 07:05:40.349570 24012 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:40.349742 24012 heartbeater.cc:511] Master 127.26.23.190:40815 requested a full tablet report, sending...
I20260808 07:05:40.350283 23705 ts_manager.cc:194] Registered new tserver with Master: 6527afe58c8d4c768a46c76e41e6b16e (127.26.23.129:44967)
I20260808 07:05:40.350459 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 23792
I20260808 07:05:40.350553 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:40.350739 26718 external_mini_cluster.cc:1428] Setting key 136c6d1ecf176bb5e3ffc220400c99e0
I20260808 07:05:40.351009 23705 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.129:48177
I20260808 07:05:40.351845 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40815
--builtin_ntp_servers=127.26.23.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:40.433125 24016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:40.433350 24016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:40.433382 24016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:40.434523 24016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:40.434561 24016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:40.434594 24016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:40.435926 24016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:40.436163 24016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:40.436439 24016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:40.441301 24034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.441331 24029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.441311 24027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:40.441457 24016 server_base.cc:1034] running on GCE node
I20260808 07:05:40.441653 24016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:40.441862 24016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:40.443022 24016 hybrid_clock.cc:648] HybridClock initialized: now 1786172740443008 us; error 26 us; skew 500 ppm
I20260808 07:05:40.444316 24016 webserver.cc:460] Webserver started at http://127.26.23.130:38481/ using document root <none> and password file <none>
I20260808 07:05:40.444561 24016 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:40.444612 24016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:40.444741 24016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:40.445779 24016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "72c6035a02134e2386f4da91749cd391"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "2a8bc989f8d65f9945811698f515108c"
server_key_iv: "d9a657daceaae611dcf1e5075473d52d"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.446106 24016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "72c6035a02134e2386f4da91749cd391"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "2a8bc989f8d65f9945811698f515108c"
server_key_iv: "d9a657daceaae611dcf1e5075473d52d"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.447413 24016 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:40.448117 24042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.448274 24016 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:40.448359 24016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "72c6035a02134e2386f4da91749cd391"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "2a8bc989f8d65f9945811698f515108c"
server_key_iv: "d9a657daceaae611dcf1e5075473d52d"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.448421 24016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:40.457455 24016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:40.457718 24016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:40.457836 24016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:40.458025 24016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:40.458355 24016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:40.458391 24016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.458418 24016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:40.458443 24016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.464073 24016 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:38631
I20260808 07:05:40.464134 24208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:38631 every 8 connection(s)
I20260808 07:05:40.464406 24016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:40.467103 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 24016
I20260808 07:05:40.467180 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:40.467362 26718 external_mini_cluster.cc:1428] Setting key 00a1e3a3d2fc75b36fab3cb2df3f3aa6
I20260808 07:05:40.468271 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40815
--builtin_ntp_servers=127.26.23.148:34235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 07:05:40.469669 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.465110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:32855 (local address 127.26.23.190:40815)
0808 07:05:40.465159 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.465161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.465363 (+ 202us) server_negotiation.cc:407] Connection header received
0808 07:05:40.465925 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.465927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.465940 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.465993 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:40.466706 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.467242 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.468377 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.468585 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.468639 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.469419 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:40.469421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:40.469421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:40.469426 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:40.469442 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:40.469446 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:40.469491 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.469561 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.469587 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:05:40.469982 24212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.465081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40815 (local address 127.26.23.130:32855)
0808 07:05:40.465251 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.465283 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.465817 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.466057 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.466061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.466072 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:40.466614 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.466620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.467327 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.467328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.468302 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.468305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.468653 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.468654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.468789 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.469290 (+ 501us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:40.469291 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:40.469318 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:40.469339 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:40.469498 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:40.469503 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:40.469506 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.469565 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.469707 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260808 07:05:40.470461 24210 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40815
I20260808 07:05:40.470558 24210 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:40.470752 24210 heartbeater.cc:511] Master 127.26.23.190:40815 requested a full tablet report, sending...
I20260808 07:05:40.471117 23704 ts_manager.cc:194] Registered new tserver with Master: 72c6035a02134e2386f4da91749cd391 (127.26.23.130:38631)
I20260808 07:05:40.471544 23704 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.130:32855
W20260808 07:05:40.550758 24214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:40.550985 24214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:40.551010 24214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:40.552129 24214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:40.552166 24214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:40.552191 24214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:40.553469 24214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:34235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:40815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:40.553671 24214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:40.553965 24214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:40.559146 24222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:40.559121 24223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:40.559176 24214 server_base.cc:1034] running on GCE node
W20260808 07:05:40.559128 24226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:40.559480 24214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:40.559721 24214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:40.560859 24214 hybrid_clock.cc:648] HybridClock initialized: now 1786172740560851 us; error 32 us; skew 500 ppm
I20260808 07:05:40.562047 24214 webserver.cc:460] Webserver started at http://127.26.23.131:35591/ using document root <none> and password file <none>
I20260808 07:05:40.562319 24214 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:40.562368 24214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:40.562507 24214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:40.563584 24214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "8fb0261e4000438f8f142b82f549f363"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "0cdc637ac7c2aa88f07408c33a4384aa"
server_key_iv: "c3153ae522d239b62ca003d3fac53645"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.563938 24214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "8fb0261e4000438f8f142b82f549f363"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "0cdc637ac7c2aa88f07408c33a4384aa"
server_key_iv: "c3153ae522d239b62ca003d3fac53645"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.565181 24214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:40.565860 24233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.565999 24214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:40.566085 24214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "8fb0261e4000438f8f142b82f549f363"
format_stamp: "Formatted at 2026-08-08 07:05:40 on dist-test-slave-zj8q"
server_key: "0cdc637ac7c2aa88f07408c33a4384aa"
server_key_iv: "c3153ae522d239b62ca003d3fac53645"
server_key_version: "encryptionkey@0"
I20260808 07:05:40.566170 24214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:40.579295 24214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:40.579584 24214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:40.579727 24214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:40.579934 24214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:40.580262 24214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:40.580296 24214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.580325 24214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:40.580343 24214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:40.585995 24214 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:44087
I20260808 07:05:40.586056 24406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:44087 every 8 connection(s)
I20260808 07:05:40.586427 24214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:40.591557 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.587193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:33725 (local address 127.26.23.190:40815)
0808 07:05:40.587264 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.587266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.587468 (+ 202us) server_negotiation.cc:407] Connection header received
0808 07:05:40.587975 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.587977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.587990 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.588037 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:40.588757 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.589270 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.590239 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.590451 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.590506 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.591302 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:40.591304 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:40.591304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:40.591309 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:40.591325 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:40.591329 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:40.591374 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.591448 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.591475 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 07:05:40.591763 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.587157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:40815 (local address 127.26.23.131:33725)
0808 07:05:40.587356 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.587389 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.587880 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.588156 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.588160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.588168 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:40.588668 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.588672 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.589356 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.589357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.590145 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.590147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.590526 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.590527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.590666 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.591168 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:40.591168 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:40.591196 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:40.591220 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:40.591380 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:40.591385 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:40.591388 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.591446 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.591549 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
I20260808 07:05:40.592190 24409 heartbeater.cc:347] Connected to a master server at 127.26.23.190:40815
I20260808 07:05:40.592278 24409 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:40.592453 24409 heartbeater.cc:511] Master 127.26.23.190:40815 requested a full tablet report, sending...
I20260808 07:05:40.592794 23704 ts_manager.cc:194] Registered new tserver with Master: 8fb0261e4000438f8f142b82f549f363 (127.26.23.131:44087)
I20260808 07:05:40.593169 23704 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.131:33725
I20260808 07:05:40.594437 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 24214
I20260808 07:05:40.594532 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:40.594700 26718 external_mini_cluster.cc:1428] Setting key 26f64950ede880a2da5e22e91069ae80
I20260808 07:05:40.595515 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:40.599665 23763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.596933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56614 (local address 127.26.23.190:40815)
0808 07:05:40.596974 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.596976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.597144 (+ 168us) server_negotiation.cc:407] Connection header received
0808 07:05:40.597166 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.597167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.597176 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.597214 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:40.597351 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.597799 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.598586 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.598776 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.598826 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.599441 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:40.599442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:40.599442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:40.599446 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:40.599458 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:40.599462 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:40.599525 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.599588 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.599597 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:05:40.601099 23704 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:40.602794 23704 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:40.609225 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.605053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:44087 (local address 127.0.0.1:36090)
0808 07:05:40.605183 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.605198 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.605264 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.605502 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.605504 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.605506 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:40.605587 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.605590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.606954 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.606955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.608010 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.608013 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.608966 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.609027 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.609032 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.609078 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.609120 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":43,"thread_start_us":61,"threads_started":1}
I20260808 07:05:40.609272 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.604961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33398 (local address 127.26.23.129:44967)
0808 07:05:40.605629 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.605633 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.605642 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:40.605681 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.605683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.605697 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.605765 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:40.605893 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.607000 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608283 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.608975 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.609037 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.609114 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.609166 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.609200 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":82,"threads_started":1}
I20260808 07:05:40.609298 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.604951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45638 (local address 127.26.23.130:38631)
0808 07:05:40.605906 (+ 955us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.605910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.605918 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:40.605952 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.605953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.605964 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.606029 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:40.606146 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.606845 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608327 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.608805 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608866 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.608952 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.609181 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.609216 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":913,"thread_start_us":88,"threads_started":1}
I20260808 07:05:40.609480 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.605177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.26.23.131:44087)
0808 07:05:40.605366 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.605371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.605381 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:40.605415 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.605416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.605427 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.605487 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:40.605683 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.606845 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608087 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.608769 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608838 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.608928 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.609361 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.609405 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":90,"threads_started":1}
I20260808 07:05:40.609601 24423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.604851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:38631 (local address 127.0.0.1:45638)
0808 07:05:40.605156 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.605196 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.605264 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.606038 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.606040 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.606042 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:40.606086 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.606088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.606919 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.606920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.608261 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.608263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.608879 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.608880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.608957 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.608971 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.609032 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.609084 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":28,"thread_start_us":56,"threads_started":1}
I20260808 07:05:40.610147 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.604854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44967 (local address 127.0.0.1:33398)
0808 07:05:40.605172 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.605201 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.605264 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.605776 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.605777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.605779 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:40.605814 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.605815 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.607091 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.607092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.608188 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.608191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.609040 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.609041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.609094 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.609097 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.609152 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.609190 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":3,"thread_start_us":103,"threads_started":1}
I20260808 07:05:40.610344 24306 tablet_service.cc:1467] Processing CreateTablet for tablet 6676caf7525c417998edf35a49955439 (DEFAULT_TABLE table=test-table [id=0a088dca324e443e9be3168b86c96941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:40.610345 24109 tablet_service.cc:1467] Processing CreateTablet for tablet 6676caf7525c417998edf35a49955439 (DEFAULT_TABLE table=test-table [id=0a088dca324e443e9be3168b86c96941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:40.610714 24306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6676caf7525c417998edf35a49955439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:40.610715 24109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6676caf7525c417998edf35a49955439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:40.611045 23903 tablet_service.cc:1467] Processing CreateTablet for tablet 6676caf7525c417998edf35a49955439 (DEFAULT_TABLE table=test-table [id=0a088dca324e443e9be3168b86c96941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:40.611341 23903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6676caf7525c417998edf35a49955439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:40.613709 24430 tablet_bootstrap.cc:492] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: Bootstrap starting.
I20260808 07:05:40.614095 24432 tablet_bootstrap.cc:492] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Bootstrap starting.
I20260808 07:05:40.614446 24430 tablet_bootstrap.cc:654] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:40.614746 24432 tablet_bootstrap.cc:654] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:40.614784 24430 log.cc:824] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:40.615046 24432 log.cc:824] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:40.615340 24434 tablet_bootstrap.cc:492] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Bootstrap starting.
I20260808 07:05:40.615520 24430 tablet_bootstrap.cc:492] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: No bootstrap required, opened a new log
I20260808 07:05:40.615584 24430 ts_tablet_manager.cc:1397] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:40.615746 24432 tablet_bootstrap.cc:492] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: No bootstrap required, opened a new log
I20260808 07:05:40.615813 24432 ts_tablet_manager.cc:1397] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:40.615944 24434 tablet_bootstrap.cc:654] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:40.616262 24434 log.cc:824] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:40.617031 24434 tablet_bootstrap.cc:492] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: No bootstrap required, opened a new log
I20260808 07:05:40.617100 24434 ts_tablet_manager.cc:1397] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:40.617745 24430 raft_consensus.cc:348] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.617877 24430 raft_consensus.cc:374] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:40.617909 24430 raft_consensus.cc:729] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6527afe58c8d4c768a46c76e41e6b16e, State: Initialized, Role: FOLLOWER
I20260808 07:05:40.618023 24430 consensus_queue.cc:260] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.618314 24430 ts_tablet_manager.cc:1428] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260808 07:05:40.618343 24012 heartbeater.cc:503] Master 127.26.23.190:40815 was elected leader, sending a full tablet report...
I20260808 07:05:40.618247 24432 raft_consensus.cc:348] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.618706 24432 raft_consensus.cc:374] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:40.618757 24432 raft_consensus.cc:729] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fb0261e4000438f8f142b82f549f363, State: Initialized, Role: FOLLOWER
I20260808 07:05:40.618872 24432 consensus_queue.cc:260] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.619264 24432 ts_tablet_manager.cc:1428] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:40.619405 24409 heartbeater.cc:503] Master 127.26.23.190:40815 was elected leader, sending a full tablet report...
I20260808 07:05:40.619489 24434 raft_consensus.cc:348] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.619628 24434 raft_consensus.cc:374] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:40.619670 24434 raft_consensus.cc:729] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72c6035a02134e2386f4da91749cd391, State: Initialized, Role: FOLLOWER
I20260808 07:05:40.619779 24434 consensus_queue.cc:260] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.620036 24434 ts_tablet_manager.cc:1428] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:40.620048 24210 heartbeater.cc:503] Master 127.26.23.190:40815 was elected leader, sending a full tablet report...
W20260808 07:05:40.714954 24211 tablet.cc:2369] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:40.715291 24442 raft_consensus.cc:482] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:40.715391 24442 raft_consensus.cc:504] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.715758 24442 leader_election.cc:288] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6527afe58c8d4c768a46c76e41e6b16e (127.26.23.129:44967), 8fb0261e4000438f8f142b82f549f363 (127.26.23.131:44087)
I20260808 07:05:40.719499 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.716035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:55945 (local address 127.26.23.129:44967)
0808 07:05:40.716090 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.716092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.716131 (+ 39us) server_negotiation.cc:407] Connection header received
0808 07:05:40.716161 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.716162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.716175 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.716238 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:40.716398 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.717147 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.718609 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.719165 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.719232 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.719240 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.719396 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.719433 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:40.719528 24212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.715961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44967 (local address 127.26.23.130:55945)
0808 07:05:40.716045 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.716057 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.716100 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.716253 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.716254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.716256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:40.716326 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.716328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.717239 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.717240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.718509 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.718513 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.719241 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.719243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.719321 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.719325 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.719383 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.719435 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":13}
I20260808 07:05:40.719534 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.715961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:44087 (local address 127.26.23.130:39727)
0808 07:05:40.716177 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.716187 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:40.716237 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:40.716362 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:40.716363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:40.716365 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:40.716418 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.716419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.717244 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.717244 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.718512 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:40.718514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.719242 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.719243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:40.719331 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.719333 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:40.719383 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 07:05:40.719431 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":73,"thread_start_us":101,"threads_started":1}
I20260808 07:05:40.719676 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.716114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:39727 (local address 127.26.23.131:44087)
0808 07:05:40.716167 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.716169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.716237 (+ 68us) server_negotiation.cc:407] Connection header received
0808 07:05:40.716290 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.716290 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.716299 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.716342 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:40.716473 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.717173 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.718592 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.719159 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.719232 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.719240 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.719539 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.719582 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 07:05:40.719942 24342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6676caf7525c417998edf35a49955439" candidate_uuid: "72c6035a02134e2386f4da91749cd391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fb0261e4000438f8f142b82f549f363" is_pre_election: true
I20260808 07:05:40.719944 23937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6676caf7525c417998edf35a49955439" candidate_uuid: "72c6035a02134e2386f4da91749cd391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6527afe58c8d4c768a46c76e41e6b16e" is_pre_election: true
I20260808 07:05:40.720093 23937 raft_consensus.cc:2454] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72c6035a02134e2386f4da91749cd391 in term 0.
I20260808 07:05:40.720093 24342 raft_consensus.cc:2454] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72c6035a02134e2386f4da91749cd391 in term 0.
I20260808 07:05:40.720340 24046 leader_election.cc:302] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6527afe58c8d4c768a46c76e41e6b16e, 72c6035a02134e2386f4da91749cd391; no voters:
I20260808 07:05:40.720468 24442 raft_consensus.cc:2781] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:40.720530 24442 raft_consensus.cc:482] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:40.720553 24442 raft_consensus.cc:3037] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:40.721292 24442 raft_consensus.cc:504] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.721417 24442 leader_election.cc:288] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [CANDIDATE]: Term 1 election: Requested vote from peers 6527afe58c8d4c768a46c76e41e6b16e (127.26.23.129:44967), 8fb0261e4000438f8f142b82f549f363 (127.26.23.131:44087)
I20260808 07:05:40.721554 23937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6676caf7525c417998edf35a49955439" candidate_uuid: "72c6035a02134e2386f4da91749cd391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6527afe58c8d4c768a46c76e41e6b16e"
I20260808 07:05:40.721626 24342 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6676caf7525c417998edf35a49955439" candidate_uuid: "72c6035a02134e2386f4da91749cd391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fb0261e4000438f8f142b82f549f363"
I20260808 07:05:40.721666 23937 raft_consensus.cc:3037] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:40.721694 24342 raft_consensus.cc:3037] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:40.722613 23937 raft_consensus.cc:2454] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72c6035a02134e2386f4da91749cd391 in term 1.
I20260808 07:05:40.722658 24342 raft_consensus.cc:2454] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72c6035a02134e2386f4da91749cd391 in term 1.
I20260808 07:05:40.722784 24046 leader_election.cc:302] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6527afe58c8d4c768a46c76e41e6b16e, 72c6035a02134e2386f4da91749cd391; no voters:
I20260808 07:05:40.722956 24442 raft_consensus.cc:2781] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:40.723122 24442 raft_consensus.cc:686] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 1 LEADER]: Becoming Leader. State: Replica: 72c6035a02134e2386f4da91749cd391, State: Running, Role: LEADER
I20260808 07:05:40.723232 24442 consensus_queue.cc:237] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } }
I20260808 07:05:40.724000 23703 catalog_manager.cc:5495] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72c6035a02134e2386f4da91749cd391 (127.26.23.130). New cstate: current_term: 1 leader_uuid: "72c6035a02134e2386f4da91749cd391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72c6035a02134e2386f4da91749cd391" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 38631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:40.756698 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.754218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45644 (local address 127.26.23.130:38631)
0808 07:05:40.754275 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:40.754277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:40.754286 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:40.754363 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:40.754364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:40.754386 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:40.754447 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:40.754552 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.755038 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.755825 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:40.756013 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:40.756060 (+ 47us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:40.756315 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:40.756403 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:40.756473 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:40.756581 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 07:05:40.756589 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:40.758498 24342 raft_consensus.cc:1261] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 1 FOLLOWER]: Refusing update from remote peer 72c6035a02134e2386f4da91749cd391: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:40.758525 23937 raft_consensus.cc:1261] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 1 FOLLOWER]: Refusing update from remote peer 72c6035a02134e2386f4da91749cd391: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:40.758849 24446 consensus_queue.cc:1035] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fb0261e4000438f8f142b82f549f363" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 44087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:40.758970 24442 consensus_queue.cc:1035] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6527afe58c8d4c768a46c76e41e6b16e" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 44967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:40.761389 24449 mvcc.cc:205] Tried to move back new op lower bound from 7316163546144301056 to 7316163546002841600. Current Snapshot: MvccSnapshot[applied={T|T < 7316163546144301056}]
I20260808 07:05:40.761408 24453 mvcc.cc:205] Tried to move back new op lower bound from 7316163546144301056 to 7316163546002841600. Current Snapshot: MvccSnapshot[applied={T|T < 7316163546144301056}]
I20260808 07:05:40.763773 23704 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:40.763870 23704 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:40.764567 23704 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b483b47e6d904cbd8796f9f57e562f75: Sending DeleteTablet for 3 replicas of tablet 6676caf7525c417998edf35a49955439
I20260808 07:05:40.764907 24109 tablet_service.cc:1514] Processing DeleteTablet for tablet 6676caf7525c417998edf35a49955439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:40 UTC) from {username='slave'} at 127.0.0.1:45638
I20260808 07:05:40.764922 23903 tablet_service.cc:1514] Processing DeleteTablet for tablet 6676caf7525c417998edf35a49955439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:40 UTC) from {username='slave'} at 127.0.0.1:33398
I20260808 07:05:40.764911 24306 tablet_service.cc:1514] Processing DeleteTablet for tablet 6676caf7525c417998edf35a49955439 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:40 UTC) from {username='slave'} at 127.0.0.1:36090
I20260808 07:05:40.765136 24474 tablet_replica.cc:330] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: stopping tablet replica
I20260808 07:05:40.765232 24474 raft_consensus.cc:2229] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:40.765338 24474 raft_consensus.cc:2258] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:40.765569 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 23792
I20260808 07:05:40.765799 24474 ts_tablet_manager.cc:1905] T 6676caf7525c417998edf35a49955439 P 6527afe58c8d4c768a46c76e41e6b16e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:40.773464 24468 tablet_replica.cc:330] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: stopping tablet replica
I20260808 07:05:40.765344 24472 tablet_replica.cc:330] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: stopping tablet replica
I20260808 07:05:40.773716 24472 raft_consensus.cc:2229] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:40.773876 24472 raft_consensus.cc:2258] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:40.774091 24468 raft_consensus.cc:2229] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:40.774240 24468 raft_consensus.cc:2258] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:40.774519 24472 ts_tablet_manager.cc:1905] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:40.774703 24468 ts_tablet_manager.cc:1905] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:40.776355 24472 ts_tablet_manager.cc:1918] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:40.776362 24468 ts_tablet_manager.cc:1918] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:40.776427 24468 log.cc:1196] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/6676caf7525c417998edf35a49955439
I20260808 07:05:40.776541 24472 log.cc:1196] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/6676caf7525c417998edf35a49955439
I20260808 07:05:40.776676 24468 ts_tablet_manager.cc:1939] T 6676caf7525c417998edf35a49955439 P 72c6035a02134e2386f4da91749cd391: Deleting consensus metadata
I20260808 07:05:40.776902 24472 ts_tablet_manager.cc:1939] T 6676caf7525c417998edf35a49955439 P 8fb0261e4000438f8f142b82f549f363: Deleting consensus metadata
I20260808 07:05:40.777100 23686 catalog_manager.cc:4841] TS 72c6035a02134e2386f4da91749cd391 (127.26.23.130:38631): tablet 6676caf7525c417998edf35a49955439 (table test-table [id=0a088dca324e443e9be3168b86c96941]) successfully deleted
I20260808 07:05:40.777410 23686 catalog_manager.cc:4841] TS 8fb0261e4000438f8f142b82f549f363 (127.26.23.131:44087): tablet 6676caf7525c417998edf35a49955439 (table test-table [id=0a088dca324e443e9be3168b86c96941]) successfully deleted
W20260808 07:05:40.778872 23685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:44967 (error 108)
I20260808 07:05:40.779388 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:40.779268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:44967 (local address 127.0.0.1:33408)
0808 07:05:40.779317 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:40.779355 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:44967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:05:40.779493 23685 catalog_manager.cc:4584] TS 6527afe58c8d4c768a46c76e41e6b16e (127.26.23.129:44967): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6676caf7525c417998edf35a49955439: Network error: Client connection negotiation failed: client connection to 127.26.23.129:44967: connect: Connection refused (error 111)
I20260808 07:05:40.779722 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 24016
I20260808 07:05:40.799667 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 24214
I20260808 07:05:40.806412 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 23662
2026-08-08T07:05:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (765 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:40 dist-test-slave-zj8q krb5kdc[24483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:40 dist-test-slave-zj8q krb5kdc[24483](info): set up 2 sockets
Aug 08 07:05:40 dist-test-slave-zj8q krb5kdc[24483](info): commencing operation
krb5kdc: starting...
W20260808 07:05:41.945434 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:05:42.061462 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:38471
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:38471
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:42.144173 24499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:42.144387 24499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:42.144418 24499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:42.145557 24499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:42.145599 24499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:42.145617 24499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:42.145635 24499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:42.145650 24499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:42.147182 24499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:38471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:38471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:42.147430 24499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:42.147635 24499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:42.152289 24510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.152354 24499 server_base.cc:1034] running on GCE node
W20260808 07:05:42.152321 24507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.152289 24505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.152730 24499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:42.152995 24499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:42.154201 24499 hybrid_clock.cc:648] HybridClock initialized: now 1786172742154164 us; error 50 us; skew 500 ppm
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:42.156605 24499 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:05:42.157012 24499 webserver.cc:460] Webserver started at http://127.26.23.190:35753/ using document root <none> and password file <none>
I20260808 07:05:42.157212 24499 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:42.157253 24499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:42.157343 24499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:42.158382 24499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "bf8afeef65a14f55b0596a59af9397a0"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "9e9d1006d6f940b1d638f63a94acce0a"
server_key_iv: "7fa93140d30615be2d590032d36b142b"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.158687 24499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "bf8afeef65a14f55b0596a59af9397a0"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "9e9d1006d6f940b1d638f63a94acce0a"
server_key_iv: "7fa93140d30615be2d590032d36b142b"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.159884 24499 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:42.160542 24523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.160705 24499 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:42.160784 24499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "bf8afeef65a14f55b0596a59af9397a0"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "9e9d1006d6f940b1d638f63a94acce0a"
server_key_iv: "7fa93140d30615be2d590032d36b142b"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.160851 24499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:42.172418 24499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:42.174218 24499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:42.174348 24499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:42.178427 24499 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:38471
I20260808 07:05:42.178478 24606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:38471 every 8 connection(s)
I20260808 07:05:42.178889 24499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:42.179759 24607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:42.182242 24607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0: Bootstrap starting.
I20260808 07:05:42.182837 24607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:42.183099 24607 log.cc:824] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:42.183835 24607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0: No bootstrap required, opened a new log
I20260808 07:05:42.185462 24607 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8afeef65a14f55b0596a59af9397a0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38471 } }
I20260808 07:05:42.185632 24607 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:42.185670 24607 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8afeef65a14f55b0596a59af9397a0, State: Initialized, Role: FOLLOWER
I20260808 07:05:42.185807 24607 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8afeef65a14f55b0596a59af9397a0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38471 } }
I20260808 07:05:42.185870 24607 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:42.185899 24607 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:42.185947 24607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:42.186547 24607 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8afeef65a14f55b0596a59af9397a0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38471 } }
I20260808 07:05:42.186655 24607 leader_election.cc:302] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf8afeef65a14f55b0596a59af9397a0; no voters:
I20260808 07:05:42.186818 24607 leader_election.cc:288] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:42.186862 24613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:42.187031 24613 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [term 1 LEADER]: Becoming Leader. State: Replica: bf8afeef65a14f55b0596a59af9397a0, State: Running, Role: LEADER
I20260808 07:05:42.187127 24613 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8afeef65a14f55b0596a59af9397a0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38471 } }
I20260808 07:05:42.187250 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 24499
I20260808 07:05:42.187352 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:42.187490 24615 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf8afeef65a14f55b0596a59af9397a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8afeef65a14f55b0596a59af9397a0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38471 } } }
I20260808 07:05:42.187557 26718 external_mini_cluster.cc:1428] Setting key b4b73a2cfcd36a9bfc12dc10be86e420
I20260808 07:05:42.187562 24615 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:42.187672 24616 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf8afeef65a14f55b0596a59af9397a0. Latest consensus state: current_term: 1 leader_uuid: "bf8afeef65a14f55b0596a59af9397a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf8afeef65a14f55b0596a59af9397a0" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 38471 } } }
I20260808 07:05:42.187798 24607 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:42.187839 24621 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:42.187840 24616 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:42.188432 24621 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:42.190045 24621 catalog_manager.cc:1347] Generated new cluster ID: 2d55993eae3c4101ac8552685108420b
I20260808 07:05:42.190090 24621 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:42.200209 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.188258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.26.23.190:38471)
0808 07:05:42.188466 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.188475 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.189307 (+ 832us) server_negotiation.cc:407] Connection header received
0808 07:05:42.189454 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.189461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.189518 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.189758 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:42.190664 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.192013 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.193024 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.193621 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.193704 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.196467 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:42.196471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:42.196472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:42.196483 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:42.198366 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.198725 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.198728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.198729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.198824 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.198983 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.198983 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.198984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.199262 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:42.199387 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.199843 (+ 456us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.199977 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":101,"threads_started":1}
I20260808 07:05:42.203594 24621 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:42.204070 24621 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:42.213264 24621 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0: Generated new TSK 0
I20260808 07:05:42.213425 24621 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.26.23.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
Entry for principal kudu/127.26.23.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab.
I20260808 07:05:42.238385 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:38471
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:42.324899 24650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:42.325104 24650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:42.325136 24650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:42.326397 24650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:42.326450 24650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:42.326485 24650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:42.328164 24650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.129.keytab
--principal=kudu/127.26.23.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:38471
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:42.328393 24650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:42.328608 24650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:42.333516 24663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.333693 24650 server_base.cc:1034] running on GCE node
W20260808 07:05:42.333524 24658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.333518 24659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.334025 24650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:42.334313 24650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:42.335462 24650 hybrid_clock.cc:648] HybridClock initialized: now 1786172742335446 us; error 30 us; skew 500 ppm
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:42.337859 24650 init.cc:377] Logged in from keytab as kudu/127.26.23.129@KRBTEST.COM (short username kudu)
I20260808 07:05:42.338354 24650 webserver.cc:460] Webserver started at http://127.26.23.129:33453/ using document root <none> and password file <none>
I20260808 07:05:42.338577 24650 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:42.338624 24650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:42.338750 24650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:42.339761 24650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "504ba93db66947b4bda45094cbc6112f"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "e130b6c5f80a4f55f457e5116871d01d"
server_key_iv: "242ce54346477ee9aa5dd03b0750c37f"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.340094 24650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "504ba93db66947b4bda45094cbc6112f"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "e130b6c5f80a4f55f457e5116871d01d"
server_key_iv: "242ce54346477ee9aa5dd03b0750c37f"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.341295 24650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:42.341928 24676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.342082 24650 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:42.342182 24650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "504ba93db66947b4bda45094cbc6112f"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "e130b6c5f80a4f55f457e5116871d01d"
server_key_iv: "242ce54346477ee9aa5dd03b0750c37f"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.342253 24650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:42.359022 24650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:42.360733 24650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:42.360860 24650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:42.361066 24650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:42.361363 24650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:42.361397 24650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.361423 24650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:42.361447 24650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.367269 24650 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:43127
I20260808 07:05:42.367326 24867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:43127 every 8 connection(s)
I20260808 07:05:42.367604 24650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.129@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:42.374058 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 24650
I20260808 07:05:42.374176 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:42.374400 26718 external_mini_cluster.cc:1428] Setting key cb1a9cefd220657fde7dcf3b425bfa37
I20260808 07:05:42.376137 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.368226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:43851 (local address 127.26.23.190:38471)
0808 07:05:42.368272 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.368275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.368471 (+ 196us) server_negotiation.cc:407] Connection header received
0808 07:05:42.368927 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.368928 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.368941 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.368994 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:42.369904 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.370420 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.371375 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.371559 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.371600 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.373542 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:42.373544 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:42.373544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:42.373552 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:42.374856 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.375235 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.375236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.375236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.375294 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.375511 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.375512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.375512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.375631 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:42.375685 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.375946 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.376042 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:42.376328 24875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.368187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:38471 (local address 127.26.23.129:43851)
0808 07:05:42.368349 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.368391 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.368855 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.369057 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.369061 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.369646 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:42.369833 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.369838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.370482 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.370483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.371312 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.371315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.371638 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.371639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.371735 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.372108 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:42.372116 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:42.373446 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:42.374930 (+ 1484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:42.374937 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:42.374939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:42.375167 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:42.375351 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:42.375352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:42.375352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:42.375453 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:42.375686 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:42.375693 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:42.375825 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.375912 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.376063 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260808 07:05:42.376801 24872 heartbeater.cc:347] Connected to a master server at 127.26.23.190:38471
I20260808 07:05:42.376905 24872 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:42.377086 24872 heartbeater.cc:511] Master 127.26.23.190:38471 requested a full tablet report, sending...
I20260808 07:05:42.377619 24551 ts_manager.cc:194] Registered new tserver with Master: 504ba93db66947b4bda45094cbc6112f (127.26.23.129:43127)
I20260808 07:05:42.378291 24551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.129@KRBTEST.COM'} at 127.26.23.129:43851
WARNING: no policy specified for kudu/127.26.23.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
Entry for principal kudu/127.26.23.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab.
I20260808 07:05:42.398772 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:38471
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:42.478413 24878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:42.478607 24878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:42.478637 24878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:42.479755 24878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:42.479797 24878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:42.479831 24878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:42.481241 24878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.130.keytab
--principal=kudu/127.26.23.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:38471
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:42.481472 24878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:42.481670 24878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:42.486675 24885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.486774 24878 server_base.cc:1034] running on GCE node
W20260808 07:05:42.486713 24884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.486886 24887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.487074 24878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:42.487300 24878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:42.488433 24878 hybrid_clock.cc:648] HybridClock initialized: now 1786172742488417 us; error 34 us; skew 500 ppm
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:42.490847 24878 init.cc:377] Logged in from keytab as kudu/127.26.23.130@KRBTEST.COM (short username kudu)
I20260808 07:05:42.491245 24878 webserver.cc:460] Webserver started at http://127.26.23.130:37969/ using document root <none> and password file <none>
I20260808 07:05:42.491449 24878 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:42.491496 24878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:42.491624 24878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:42.492614 24878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "5262943c4d074e43ba2113ac479facfd"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "826543cc39207ead0ba142de59050244"
server_key_iv: "dc729ffcfa86a0ab168ea67e68e9727e"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.492942 24878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "5262943c4d074e43ba2113ac479facfd"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "826543cc39207ead0ba142de59050244"
server_key_iv: "dc729ffcfa86a0ab168ea67e68e9727e"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.494166 24878 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:05:42.494831 24896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.494976 24878 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:42.495069 24878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "5262943c4d074e43ba2113ac479facfd"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "826543cc39207ead0ba142de59050244"
server_key_iv: "dc729ffcfa86a0ab168ea67e68e9727e"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.495153 24878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:42.503821 24878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:42.505421 24878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:42.505561 24878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:42.505755 24878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:42.506021 24878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:42.506053 24878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.506080 24878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:42.506111 24878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.511722 24878 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:39035
I20260808 07:05:42.511782 25073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:39035 every 8 connection(s)
I20260808 07:05:42.512050 24878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:42.513149 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 24878
I20260808 07:05:42.513247 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:42.513419 26718 external_mini_cluster.cc:1428] Setting key a84f69e6130a5487218b68f4732f286e
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.130@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:42.521299 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.512726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:47157 (local address 127.26.23.190:38471)
0808 07:05:42.512776 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.512778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.512949 (+ 171us) server_negotiation.cc:407] Connection header received
0808 07:05:42.513454 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.513456 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.513469 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.513532 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:42.514586 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.515241 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.516414 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.516603 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.516659 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.518821 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:42.518823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:42.518823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:42.518830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:42.520079 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.520443 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.520444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.520444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.520498 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.520712 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.520713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.520713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.520820 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:42.520876 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.521126 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.521208 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:05:42.521451 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.512672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:38471 (local address 127.26.23.130:47157)
0808 07:05:42.512838 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.512872 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.513357 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.513625 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.513629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.514312 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:42.514495 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.514500 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.515318 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.515319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.516331 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.516335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.516683 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.516684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.516815 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.517260 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:42.517270 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:42.518735 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:42.520159 (+ 1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:42.520166 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:42.520168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:42.520377 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:42.520553 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:42.520553 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:42.520554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:42.520657 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:42.520875 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:42.520882 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:42.521011 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.521095 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.521251 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
I20260808 07:05:42.521847 25076 heartbeater.cc:347] Connected to a master server at 127.26.23.190:38471
I20260808 07:05:42.521934 25076 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:42.522097 25076 heartbeater.cc:511] Master 127.26.23.190:38471 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.26.23.131@KRBTEST.COM; defaulting to no policy
I20260808 07:05:42.522490 24551 ts_manager.cc:194] Registered new tserver with Master: 5262943c4d074e43ba2113ac479facfd (127.26.23.130:39035)
I20260808 07:05:42.522820 24551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.130@KRBTEST.COM'} at 127.26.23.130:47157
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
Entry for principal kudu/127.26.23.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab.
I20260808 07:05:42.538130 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:38471
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:42.617368 25084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:42.617556 25084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:42.617587 25084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:42.618710 25084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:42.618748 25084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:42.618782 25084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:42.620152 25084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.131.keytab
--principal=kudu/127.26.23.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:38471
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:42.620368 25084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:42.620568 25084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:42.625283 25095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.625290 25094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.625295 25098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.625581 25084 server_base.cc:1034] running on GCE node
I20260808 07:05:42.625774 25084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:42.625993 25084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:42.627138 25084 hybrid_clock.cc:648] HybridClock initialized: now 1786172742627111 us; error 28 us; skew 500 ppm
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:42.629475 25084 init.cc:377] Logged in from keytab as kudu/127.26.23.131@KRBTEST.COM (short username kudu)
I20260808 07:05:42.629881 25084 webserver.cc:460] Webserver started at http://127.26.23.131:38417/ using document root <none> and password file <none>
I20260808 07:05:42.630051 25084 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:42.630088 25084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:42.630223 25084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:42.631202 25084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "3886ef4aac90455487b30898ad06edda"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "dfd55405fb7a1da4796cac7d90ca7364"
server_key_iv: "38ac75c4b5f527d275d70040d4cd180b"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.631490 25084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "3886ef4aac90455487b30898ad06edda"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "dfd55405fb7a1da4796cac7d90ca7364"
server_key_iv: "38ac75c4b5f527d275d70040d4cd180b"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.632694 25084 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:42.633359 25109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.633509 25084 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:42.633591 25084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "3886ef4aac90455487b30898ad06edda"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "dfd55405fb7a1da4796cac7d90ca7364"
server_key_iv: "38ac75c4b5f527d275d70040d4cd180b"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.633690 25084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:42.651356 25084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:42.653383 25084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:42.653513 25084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:42.653753 25084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:42.654060 25084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:42.654095 25084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.654117 25084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:42.654140 25084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.659921 25084 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:36877
I20260808 07:05:42.659961 25302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:36877 every 8 connection(s)
I20260808 07:05:42.660271 25084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:42.662717 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 25084
I20260808 07:05:42.662827 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:42.663021 26718 external_mini_cluster.cc:1428] Setting key f5ff7e2fd150378e53468657bae0594e
Aug 08 07:05:42 dist-test-slave-zj8q krb5kdc[24483](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172742, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.131@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:05:42.668964 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.660961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:33837 (local address 127.26.23.190:38471)
0808 07:05:42.661014 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.661016 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.661204 (+ 188us) server_negotiation.cc:407] Connection header received
0808 07:05:42.661704 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.661706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.661720 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.661775 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:42.662741 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.663335 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.664315 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.664547 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.664601 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.666613 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:42.666615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:42.666615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:42.666648 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:42.667738 (+ 1090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.668095 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.668096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.668097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.668155 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.668365 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.668366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.668366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.668478 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:42.668534 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.668792 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.668872 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:05:42.669121 25306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.660924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:38471 (local address 127.26.23.131:33837)
0808 07:05:42.661083 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.661119 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.661597 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.661856 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.661860 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.662446 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:42.662641 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.662646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.663418 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.663419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.664232 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.664234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.664619 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.664620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.664739 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.665146 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:05:42.665155 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:42.666515 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:42.667811 (+ 1296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:42.667817 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:42.667819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:42.668029 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:42.668210 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:05:42.668211 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:05:42.668211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:05:42.668312 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:05:42.668531 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:42.668538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:42.668674 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.668759 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.668910 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260808 07:05:42.669551 25304 heartbeater.cc:347] Connected to a master server at 127.26.23.190:38471
I20260808 07:05:42.669629 25304 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:42.669795 25304 heartbeater.cc:511] Master 127.26.23.190:38471 requested a full tablet report, sending...
I20260808 07:05:42.670122 24551 ts_manager.cc:194] Registered new tserver with Master: 3886ef4aac90455487b30898ad06edda (127.26.23.131:36877)
I20260808 07:05:42.670480 24551 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.26.23.131@KRBTEST.COM'} at 127.26.23.131:33837
I20260808 07:05:42.674667 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:42.681173 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.675961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52740 (local address 127.26.23.190:38471)
0808 07:05:42.676005 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.676007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.676102 (+ 95us) server_negotiation.cc:407] Connection header received
0808 07:05:42.676164 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.676164 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.676172 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.676219 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:42.676753 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.677211 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.677865 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.678043 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.678090 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.679085 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:42.679086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:42.679087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:42.679093 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:42.680361 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.680635 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.680636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.680636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.680682 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:42.680802 (+ 120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:42.680802 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:42.680802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:42.680922 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:42.680988 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.681059 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.681113 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:42.682518 24551 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:42.684127 24551 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:42.690289 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.686302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:36877 (local address 127.0.0.1:53638)
0808 07:05:42.686676 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.686684 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.686727 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.686982 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.686982 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.686984 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:42.687012 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.687013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.688284 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.688285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.689257 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.689259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.689983 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.689984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.690062 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.690076 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.690139 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.690212 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":37,"thread_start_us":59,"threads_started":1}
I20260808 07:05:42.690310 25320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.686385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53638 (local address 127.26.23.131:36877)
0808 07:05:42.686574 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.686577 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.686729 (+ 152us) server_negotiation.cc:407] Connection header received
0808 07:05:42.686788 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.686790 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.686805 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.686874 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:42.687088 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.688172 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.689372 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.689900 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.689964 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.690023 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.690196 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.690238 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":106,"threads_started":1}
I20260808 07:05:42.690562 25319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.686285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.26.23.129:43127)
0808 07:05:42.686473 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.686477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.686519 (+ 42us) server_negotiation.cc:407] Connection header received
0808 07:05:42.686647 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.686650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.686666 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.686754 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:42.686942 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.687831 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.689263 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.689992 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.690061 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.690125 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.690440 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.690484 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":89,"threads_started":1}
I20260808 07:05:42.690654 25316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.686206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47104 (local address 127.26.23.130:39035)
0808 07:05:42.686405 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.686410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.686620 (+ 210us) server_negotiation.cc:407] Connection header received
0808 07:05:42.686682 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.686684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.686700 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.686768 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:42.687059 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.688242 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.689512 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.690206 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.690265 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.690317 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.690524 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.690566 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":90,"threads_started":1}
I20260808 07:05:42.690882 25318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.686089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:39035 (local address 127.0.0.1:47104)
0808 07:05:42.686563 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.686572 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.686620 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.686918 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.686919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.686922 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:42.686975 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.686977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.688334 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.688335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.689438 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.689441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.690347 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.690348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.690439 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.690443 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.690776 (+ 333us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.690818 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":21,"thread_start_us":78,"threads_started":1}
I20260808 07:05:42.690981 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.686088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:43127 (local address 127.0.0.1:47654)
0808 07:05:42.686420 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.686465 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.686537 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.686793 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.686796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.686798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:42.686862 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.686864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.687929 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.687929 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.689181 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.689184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.690200 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.690202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.690271 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.690275 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.690319 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.690359 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":85,"threads_started":1}
I20260808 07:05:42.691294 25199 tablet_service.cc:1467] Processing CreateTablet for tablet e71d970cddec4d65be68d07362d665ba (DEFAULT_TABLE table=test-table [id=4ff65e460add4de7ae0c6383e6bc5ffe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:42.691661 25199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71d970cddec4d65be68d07362d665ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:42.691780 24973 tablet_service.cc:1467] Processing CreateTablet for tablet e71d970cddec4d65be68d07362d665ba (DEFAULT_TABLE table=test-table [id=4ff65e460add4de7ae0c6383e6bc5ffe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:42.692078 24973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71d970cddec4d65be68d07362d665ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:42.694695 24754 tablet_service.cc:1467] Processing CreateTablet for tablet e71d970cddec4d65be68d07362d665ba (DEFAULT_TABLE table=test-table [id=4ff65e460add4de7ae0c6383e6bc5ffe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:42.694975 24754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e71d970cddec4d65be68d07362d665ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:42.695182 25324 tablet_bootstrap.cc:492] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Bootstrap starting.
I20260808 07:05:42.695278 25322 tablet_bootstrap.cc:492] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Bootstrap starting.
I20260808 07:05:42.695816 25322 tablet_bootstrap.cc:654] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:42.695858 25324 tablet_bootstrap.cc:654] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:42.696264 25322 log.cc:824] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:42.696404 25324 log.cc:824] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:42.696972 25322 tablet_bootstrap.cc:492] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: No bootstrap required, opened a new log
I20260808 07:05:42.697032 25322 ts_tablet_manager.cc:1397] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:42.697180 25324 tablet_bootstrap.cc:492] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: No bootstrap required, opened a new log
I20260808 07:05:42.697250 25324 ts_tablet_manager.cc:1397] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:42.698139 25329 tablet_bootstrap.cc:492] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: Bootstrap starting.
I20260808 07:05:42.698752 25322 raft_consensus.cc:348] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.698896 25329 tablet_bootstrap.cc:654] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:42.698936 25322 raft_consensus.cc:374] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:42.698974 25322 raft_consensus.cc:729] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3886ef4aac90455487b30898ad06edda, State: Initialized, Role: FOLLOWER
I20260808 07:05:42.699141 25322 consensus_queue.cc:260] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.699164 25324 raft_consensus.cc:348] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.699331 25324 raft_consensus.cc:374] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:42.699378 25324 raft_consensus.cc:729] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5262943c4d074e43ba2113ac479facfd, State: Initialized, Role: FOLLOWER
I20260808 07:05:42.699429 25322 ts_tablet_manager.cc:1428] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 07:05:42.699440 25329 log.cc:824] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:42.699488 25324 consensus_queue.cc:260] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.699574 25304 heartbeater.cc:503] Master 127.26.23.190:38471 was elected leader, sending a full tablet report...
I20260808 07:05:42.699786 25324 ts_tablet_manager.cc:1428] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:42.699810 25076 heartbeater.cc:503] Master 127.26.23.190:38471 was elected leader, sending a full tablet report...
I20260808 07:05:42.700098 25329 tablet_bootstrap.cc:492] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: No bootstrap required, opened a new log
I20260808 07:05:42.700158 25329 ts_tablet_manager.cc:1397] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:42.701591 25329 raft_consensus.cc:348] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.701726 25329 raft_consensus.cc:374] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:42.701747 25329 raft_consensus.cc:729] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504ba93db66947b4bda45094cbc6112f, State: Initialized, Role: FOLLOWER
I20260808 07:05:42.701822 25329 consensus_queue.cc:260] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.702008 25329 ts_tablet_manager.cc:1428] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 07:05:42.702073 24872 heartbeater.cc:503] Master 127.26.23.190:38471 was elected leader, sending a full tablet report...
I20260808 07:05:42.758215 25333 raft_consensus.cc:482] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:42.758340 25333 raft_consensus.cc:504] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.758670 25333 leader_election.cc:288] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504ba93db66947b4bda45094cbc6112f (127.26.23.129:43127), 5262943c4d074e43ba2113ac479facfd (127.26.23.130:39035)
I20260808 07:05:42.761292 25306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.758814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:43127 (local address 127.26.23.131:47553)
0808 07:05:42.758896 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.758909 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.758951 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.759138 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.759140 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.759141 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:42.759204 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.759206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.759816 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.759817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.760522 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.760523 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.761050 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.761051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.761122 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.761126 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.761173 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.761216 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 07:05:42.761292 25319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.758986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:47553 (local address 127.26.23.129:43127)
0808 07:05:42.759035 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.759037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.759045 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:42.759071 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.759072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.759081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.759127 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:42.759275 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.759749 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.760607 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.760984 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.761045 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.761055 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.761190 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.761230 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:05:42.761571 25316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.758952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:55701 (local address 127.26.23.130:39035)
0808 07:05:42.758994 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.758996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.759242 (+ 246us) server_negotiation.cc:407] Connection header received
0808 07:05:42.759274 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.759275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.759285 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.759326 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:42.759456 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.759930 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.760828 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.761209 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.761269 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.761277 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.761455 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.761497 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:42.761669 24786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71d970cddec4d65be68d07362d665ba" candidate_uuid: "3886ef4aac90455487b30898ad06edda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504ba93db66947b4bda45094cbc6112f" is_pre_election: true
I20260808 07:05:42.761773 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.758816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:39035 (local address 127.26.23.131:55701)
0808 07:05:42.759180 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.759189 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:42.759233 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:42.759337 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:42.759337 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:42.759338 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:42.759407 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.759408 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.760003 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.760004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.760747 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:42.760749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.761284 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.761285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:42.761357 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.761362 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 07:05:42.761656 (+ 294us) client_negotiation.cc:240] Negotiation successful
0808 07:05:42.761701 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":13,"thread_start_us":99,"threads_started":1}
I20260808 07:05:42.761834 24786 raft_consensus.cc:2454] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3886ef4aac90455487b30898ad06edda in term 0.
I20260808 07:05:42.762077 25115 leader_election.cc:302] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3886ef4aac90455487b30898ad06edda, 504ba93db66947b4bda45094cbc6112f; no voters:
I20260808 07:05:42.762118 25007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71d970cddec4d65be68d07362d665ba" candidate_uuid: "3886ef4aac90455487b30898ad06edda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5262943c4d074e43ba2113ac479facfd" is_pre_election: true
I20260808 07:05:42.762223 25333 raft_consensus.cc:2781] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:42.762290 25333 raft_consensus.cc:482] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:42.762283 25007 raft_consensus.cc:2454] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3886ef4aac90455487b30898ad06edda in term 0.
I20260808 07:05:42.762319 25333 raft_consensus.cc:3037] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 0 FOLLOWER]: Advancing to term 1
W20260808 07:05:42.762526 25079 tablet.cc:2369] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 07:05:42.763142 25333 raft_consensus.cc:504] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.763257 25333 leader_election.cc:288] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [CANDIDATE]: Term 1 election: Requested vote from peers 504ba93db66947b4bda45094cbc6112f (127.26.23.129:43127), 5262943c4d074e43ba2113ac479facfd (127.26.23.130:39035)
I20260808 07:05:42.763434 25007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71d970cddec4d65be68d07362d665ba" candidate_uuid: "3886ef4aac90455487b30898ad06edda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5262943c4d074e43ba2113ac479facfd"
I20260808 07:05:42.763429 24786 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e71d970cddec4d65be68d07362d665ba" candidate_uuid: "3886ef4aac90455487b30898ad06edda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504ba93db66947b4bda45094cbc6112f"
I20260808 07:05:42.763504 25007 raft_consensus.cc:3037] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:42.763509 24786 raft_consensus.cc:3037] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:42.764213 25007 raft_consensus.cc:2454] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3886ef4aac90455487b30898ad06edda in term 1.
I20260808 07:05:42.764359 24786 raft_consensus.cc:2454] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3886ef4aac90455487b30898ad06edda in term 1.
I20260808 07:05:42.764374 25113 leader_election.cc:302] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3886ef4aac90455487b30898ad06edda, 5262943c4d074e43ba2113ac479facfd; no voters:
I20260808 07:05:42.764457 25333 raft_consensus.cc:2781] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:42.764616 25333 raft_consensus.cc:686] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 1 LEADER]: Becoming Leader. State: Replica: 3886ef4aac90455487b30898ad06edda, State: Running, Role: LEADER
I20260808 07:05:42.764701 25333 consensus_queue.cc:237] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } }
I20260808 07:05:42.765460 24550 catalog_manager.cc:5495] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda reported cstate change: term changed from 0 to 1, leader changed from <none> to 3886ef4aac90455487b30898ad06edda (127.26.23.131). New cstate: current_term: 1 leader_uuid: "3886ef4aac90455487b30898ad06edda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3886ef4aac90455487b30898ad06edda" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36877 } health_report { overall_health: HEALTHY } } }
I20260808 07:05:42.781445 25320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.779297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46080 (local address 127.26.23.131:36877)
0808 07:05:42.779342 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:42.779344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:42.779353 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:42.779394 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:42.779395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:42.779411 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:42.779469 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:42.779564 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.780017 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.780816 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:42.780993 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:42.781036 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:42.781187 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:42.781282 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:42.781339 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:42.781352 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 07:05:42.781368 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 07:05:42.783207 24786 raft_consensus.cc:1261] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f [term 1 FOLLOWER]: Refusing update from remote peer 3886ef4aac90455487b30898ad06edda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:42.783231 25007 raft_consensus.cc:1261] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 1 FOLLOWER]: Refusing update from remote peer 3886ef4aac90455487b30898ad06edda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:42.783517 25339 consensus_queue.cc:1035] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [LEADER]: Connected to new peer: Peer: permanent_uuid: "5262943c4d074e43ba2113ac479facfd" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 39035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:42.783639 25333 consensus_queue.cc:1035] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [LEADER]: Connected to new peer: Peer: permanent_uuid: "504ba93db66947b4bda45094cbc6112f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 43127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:42.788184 24551 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:42.788275 24551 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:42.789018 24551 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf8afeef65a14f55b0596a59af9397a0: Sending DeleteTablet for 3 replicas of tablet e71d970cddec4d65be68d07362d665ba
I20260808 07:05:42.789325 24973 tablet_service.cc:1514] Processing DeleteTablet for tablet e71d970cddec4d65be68d07362d665ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:42 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:47104
I20260808 07:05:42.789345 24754 tablet_service.cc:1514] Processing DeleteTablet for tablet e71d970cddec4d65be68d07362d665ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:42 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:47654
I20260808 07:05:42.789538 25199 tablet_service.cc:1514] Processing DeleteTablet for tablet e71d970cddec4d65be68d07362d665ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:42 UTC) from {username='kudu', principal='kudu/127.26.23.190@KRBTEST.COM'} at 127.0.0.1:53638
I20260808 07:05:42.789587 25371 tablet_replica.cc:330] T e71d970cddec4d65be68d07362d665ba P 504ba93db66947b4bda45094cbc6112f: stopping tablet replica
I20260808 07:05:42.789691 25368 tablet_replica.cc:330] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: stopping tablet replica
I20260808 07:05:42.789788 25368 raft_consensus.cc:2229] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:42.789851 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 24650
I20260808 07:05:42.789903 25373 tablet_replica.cc:330] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: stopping tablet replica
I20260808 07:05:42.792456 25368 raft_consensus.cc:2258] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:42.797129 25368 ts_tablet_manager.cc:1905] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:42.798830 25368 ts_tablet_manager.cc:1918] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:42.798938 25368 log.cc:1196] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/e71d970cddec4d65be68d07362d665ba
I20260808 07:05:42.799213 25368 ts_tablet_manager.cc:1939] T e71d970cddec4d65be68d07362d665ba P 5262943c4d074e43ba2113ac479facfd: Deleting consensus metadata
I20260808 07:05:42.834465 24526 catalog_manager.cc:4841] TS 5262943c4d074e43ba2113ac479facfd (127.26.23.130:39035): tablet e71d970cddec4d65be68d07362d665ba (table test-table [id=4ff65e460add4de7ae0c6383e6bc5ffe]) successfully deleted
I20260808 07:05:42.835968 25373 raft_consensus.cc:2229] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 1 LEADER]: Raft consensus shutting down.
I20260808 07:05:42.836154 25373 raft_consensus.cc:2258] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:42.836671 25373 ts_tablet_manager.cc:1905] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:42.838357 25373 ts_tablet_manager.cc:1918] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:42.838441 25373 log.cc:1196] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/e71d970cddec4d65be68d07362d665ba
I20260808 07:05:42.838752 25373 ts_tablet_manager.cc:1939] T e71d970cddec4d65be68d07362d665ba P 3886ef4aac90455487b30898ad06edda: Deleting consensus metadata
I20260808 07:05:42.839207 24526 catalog_manager.cc:4841] TS 3886ef4aac90455487b30898ad06edda (127.26.23.131:36877): tablet e71d970cddec4d65be68d07362d665ba (table test-table [id=4ff65e460add4de7ae0c6383e6bc5ffe]) successfully deleted
W20260808 07:05:42.840554 24528 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:43127 (error 108)
I20260808 07:05:42.841066 25315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:42.840928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:43127 (local address 127.0.0.1:36618)
0808 07:05:42.840987 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:42.841029 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:05:42.841107 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 24878
W20260808 07:05:42.851172 24528 catalog_manager.cc:4584] TS 504ba93db66947b4bda45094cbc6112f (127.26.23.129:43127): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e71d970cddec4d65be68d07362d665ba: Network error: Client connection negotiation failed: client connection to 127.26.23.129:43127: connect: Connection refused (error 111)
I20260808 07:05:42.855880 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 25084
I20260808 07:05:42.864739 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 24499
2026-08-08T07:05:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2058 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T07:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:42Z Disabled control of system clock
I20260808 07:05:42.896138 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:44463
--webserver_interface=127.26.23.190
--webserver_port=0
--builtin_ntp_servers=127.26.23.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:44463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:42.975355 25381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:42.975569 25381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:42.975596 25381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:42.976704 25381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:42.976744 25381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:42.976760 25381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:42.976776 25381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:42.976790 25381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:42.978096 25381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:44463
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:44463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:42.978343 25381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:42.978603 25381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:42.983237 25390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.983260 25393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:42.983273 25388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:42.983487 25381 server_base.cc:1034] running on GCE node
I20260808 07:05:42.983741 25381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:42.983979 25381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:42.985126 25381 hybrid_clock.cc:648] HybridClock initialized: now 1786172742985112 us; error 29 us; skew 500 ppm
I20260808 07:05:42.986367 25381 webserver.cc:460] Webserver started at http://127.26.23.190:33349/ using document root <none> and password file <none>
I20260808 07:05:42.986577 25381 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:42.986622 25381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:42.986732 25381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:42.987802 25381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "94c0da5f197344bbac10d1a474fa13c3"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "c3a1453fc7c0fdee4875e549ab69bc77"
server_key_iv: "64b810cf1ef64ec12ff58ccf5696700e"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.988125 25381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "94c0da5f197344bbac10d1a474fa13c3"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "c3a1453fc7c0fdee4875e549ab69bc77"
server_key_iv: "64b810cf1ef64ec12ff58ccf5696700e"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.989318 25381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:42.989923 25402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:42.990073 25381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:42.990180 25381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "94c0da5f197344bbac10d1a474fa13c3"
format_stamp: "Formatted at 2026-08-08 07:05:42 on dist-test-slave-zj8q"
server_key: "c3a1453fc7c0fdee4875e549ab69bc77"
server_key_iv: "64b810cf1ef64ec12ff58ccf5696700e"
server_key_version: "encryptionkey@0"
I20260808 07:05:42.990247 25381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:43.004055 25381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:43.004305 25381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:43.004423 25381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:43.008270 25381 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:44463
I20260808 07:05:43.008313 25487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:44463 every 8 connection(s)
I20260808 07:05:43.008606 25381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:43.009513 25488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:43.009933 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 25381
I20260808 07:05:43.010039 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:43.010284 26718 external_mini_cluster.cc:1428] Setting key e98b6f15edead7c4625fcf638143965d
I20260808 07:05:43.012219 25488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3: Bootstrap starting.
I20260808 07:05:43.012796 25488 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:43.013094 25488 log.cc:824] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:43.013808 25488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3: No bootstrap required, opened a new log
I20260808 07:05:43.015457 25488 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94c0da5f197344bbac10d1a474fa13c3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44463 } }
I20260808 07:05:43.015585 25488 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:43.015614 25488 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94c0da5f197344bbac10d1a474fa13c3, State: Initialized, Role: FOLLOWER
I20260808 07:05:43.015703 25493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.010791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34482 (local address 127.26.23.190:44463)
0808 07:05:43.010954 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.010962 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.010986 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:05:43.011397 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.011403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.011457 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.011580 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:43.011802 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.012765 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.013730 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.014176 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.014262 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.014878 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:43.014882 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:43.014882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:43.015049 (+ 167us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:43.015080 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:43.015090 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:43.015137 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.015226 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.015287 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260808 07:05:43.015731 25488 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94c0da5f197344bbac10d1a474fa13c3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44463 } }
I20260808 07:05:43.015800 25488 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:43.015834 25488 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:43.015877 25488 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:43.016458 25488 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94c0da5f197344bbac10d1a474fa13c3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44463 } }
I20260808 07:05:43.016544 25488 leader_election.cc:302] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94c0da5f197344bbac10d1a474fa13c3; no voters:
I20260808 07:05:43.016696 25488 leader_election.cc:288] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:43.016760 25496 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:43.016922 25488 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:43.016933 25496 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [term 1 LEADER]: Becoming Leader. State: Replica: 94c0da5f197344bbac10d1a474fa13c3, State: Running, Role: LEADER
I20260808 07:05:43.017103 25496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94c0da5f197344bbac10d1a474fa13c3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44463 } }
I20260808 07:05:43.017504 25498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94c0da5f197344bbac10d1a474fa13c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94c0da5f197344bbac10d1a474fa13c3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44463 } } }
I20260808 07:05:43.017477 25499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94c0da5f197344bbac10d1a474fa13c3. Latest consensus state: current_term: 1 leader_uuid: "94c0da5f197344bbac10d1a474fa13c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94c0da5f197344bbac10d1a474fa13c3" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44463 } } }
I20260808 07:05:43.017563 25498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:43.017570 25499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:43.017798 25508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:43.018318 25508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:43.019796 25508 catalog_manager.cc:1347] Generated new cluster ID: 42c00033aaff447aba5e3ebc287b2637
I20260808 07:05:43.019848 25508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:43.028298 25508 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:43.028793 25508 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:43.033471 25508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3: Generated new TSK 0
I20260808 07:05:43.033614 25508 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:43.036979 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.129:0
--local_ip_for_outbound_sockets=127.26.23.129
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:44463
--builtin_ntp_servers=127.26.23.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:43.144165 25520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:43.144351 25520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:43.144371 25520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:43.145471 25520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:43.145509 25520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:43.145550 25520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.129
I20260808 07:05:43.146903 25520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.23.129
--webserver_port=0
--tserver_master_addrs=127.26.23.190:44463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25520
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.129
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:43.147147 25520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:43.147432 25520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:43.153113 25526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:43.153250 25532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:43.153273 25520 server_base.cc:1034] running on GCE node
W20260808 07:05:43.153129 25527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:43.153610 25520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:43.153846 25520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:43.154991 25520 hybrid_clock.cc:648] HybridClock initialized: now 1786172743154975 us; error 32 us; skew 500 ppm
I20260808 07:05:43.156184 25520 webserver.cc:460] Webserver started at http://127.26.23.129:33193/ using document root <none> and password file <none>
I20260808 07:05:43.156396 25520 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:43.156445 25520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:43.156570 25520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:43.157644 25520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data/instance:
uuid: "ea4d25a83088474abb3ffd4fcf268f2f"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "6625c70be66b71a7460f30764b9f4a8f"
server_key_iv: "e265e98cbecff4d0d2c5c628a16bfc14"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.157979 25520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance:
uuid: "ea4d25a83088474abb3ffd4fcf268f2f"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "6625c70be66b71a7460f30764b9f4a8f"
server_key_iv: "e265e98cbecff4d0d2c5c628a16bfc14"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.159251 25520 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:43.159976 25544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.160144 25520 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:43.160230 25520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal
uuid: "ea4d25a83088474abb3ffd4fcf268f2f"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "6625c70be66b71a7460f30764b9f4a8f"
server_key_iv: "e265e98cbecff4d0d2c5c628a16bfc14"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.160300 25520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:43.169941 25520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:43.170238 25520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:43.170392 25520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:43.170620 25520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:43.170908 25520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:43.170940 25520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.170966 25520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:43.170989 25520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.176512 25520 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.129:45967
I20260808 07:05:43.176579 25726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.129:45967 every 8 connection(s)
I20260808 07:05:43.176855 25520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/data/info.pb
I20260808 07:05:43.181773 25493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.177475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:56193 (local address 127.26.23.190:44463)
0808 07:05:43.177521 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.177523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.177759 (+ 236us) server_negotiation.cc:407] Connection header received
0808 07:05:43.178244 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.178245 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.178255 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.178314 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:43.178972 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.179462 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.180510 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.180700 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.180751 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.181543 (+ 792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:43.181544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:43.181544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:43.181548 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:43.181563 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:43.181566 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:43.181603 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.181689 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.181714 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:05:43.181914 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.177452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:44463 (local address 127.26.23.129:56193)
0808 07:05:43.177644 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.177682 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.178136 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.178373 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.178376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.178384 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:43.178906 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.178911 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.179540 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.179541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.180439 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.180442 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.180800 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.180802 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.180917 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.181416 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:43.181416 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:43.181443 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:43.181465 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:43.181618 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:43.181621 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:43.181623 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.181668 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.181741 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":72,"threads_started":1}
I20260808 07:05:43.182401 25727 heartbeater.cc:347] Connected to a master server at 127.26.23.190:44463
I20260808 07:05:43.182500 25727 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:43.182677 25727 heartbeater.cc:511] Master 127.26.23.190:44463 requested a full tablet report, sending...
I20260808 07:05:43.183174 25428 ts_manager.cc:194] Registered new tserver with Master: ea4d25a83088474abb3ffd4fcf268f2f (127.26.23.129:45967)
I20260808 07:05:43.183197 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 25520
I20260808 07:05:43.183286 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-0/wal/instance
I20260808 07:05:43.183493 26718 external_mini_cluster.cc:1428] Setting key 4c0fed21cc415b8d6c251a5c61b560a5
I20260808 07:05:43.184020 25428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.129:56193
I20260808 07:05:43.184556 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.130:0
--local_ip_for_outbound_sockets=127.26.23.130
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:44463
--builtin_ntp_servers=127.26.23.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:43.265269 25731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:43.265462 25731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:43.265482 25731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:43.266678 25731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:43.266724 25731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:43.266758 25731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.130
I20260808 07:05:43.268114 25731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.23.130
--webserver_port=0
--tserver_master_addrs=127.26.23.190:44463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.130
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:43.268348 25731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:43.268626 25731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:43.273648 25739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:43.273659 25738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:43.273654 25742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:43.273711 25731 server_base.cc:1034] running on GCE node
I20260808 07:05:43.274020 25731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:43.274284 25731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:43.275440 25731 hybrid_clock.cc:648] HybridClock initialized: now 1786172743275426 us; error 30 us; skew 500 ppm
I20260808 07:05:43.276744 25731 webserver.cc:460] Webserver started at http://127.26.23.130:33651/ using document root <none> and password file <none>
I20260808 07:05:43.276976 25731 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:43.277026 25731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:43.277160 25731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:43.278244 25731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data/instance:
uuid: "8433043122744b97b7634e17dcbfacb9"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "f4676632601e229cac6511057bedfcda"
server_key_iv: "a7f415514f8d8cffdacd578a73a293fa"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.278594 25731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance:
uuid: "8433043122744b97b7634e17dcbfacb9"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "f4676632601e229cac6511057bedfcda"
server_key_iv: "a7f415514f8d8cffdacd578a73a293fa"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.279834 25731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:43.280545 25758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.280773 25731 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:05:43.280861 25731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal
uuid: "8433043122744b97b7634e17dcbfacb9"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "f4676632601e229cac6511057bedfcda"
server_key_iv: "a7f415514f8d8cffdacd578a73a293fa"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.280928 25731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:43.295921 25731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:43.296201 25731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:43.296325 25731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:43.296523 25731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:43.296833 25731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:43.296866 25731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.296893 25731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:43.296918 25731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.302424 25731 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.130:46687
I20260808 07:05:43.302484 25954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.130:46687 every 8 connection(s)
I20260808 07:05:43.302776 25731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/data/info.pb
I20260808 07:05:43.307749 25493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.303450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.130:55169 (local address 127.26.23.190:44463)
0808 07:05:43.303497 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.303499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.303698 (+ 199us) server_negotiation.cc:407] Connection header received
0808 07:05:43.304168 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.304169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.304179 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.304236 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:43.304968 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.305464 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.306538 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.306733 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.306792 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.307493 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:43.307495 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:43.307495 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:43.307499 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:43.307513 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:43.307517 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:43.307563 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.307660 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.307686 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:05:43.307914 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.303380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:44463 (local address 127.26.23.130:55169)
0808 07:05:43.303569 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.303610 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.304093 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.304298 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.304301 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.304309 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:43.304867 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.304873 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.305606 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.305608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.306462 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.306464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.306820 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.306821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.306932 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.307372 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:43.307372 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:43.307399 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:43.307421 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:43.307602 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:43.307605 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:43.307608 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.307653 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.307729 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260808 07:05:43.308413 25955 heartbeater.cc:347] Connected to a master server at 127.26.23.190:44463
I20260808 07:05:43.308501 25955 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:43.308676 25955 heartbeater.cc:511] Master 127.26.23.190:44463 requested a full tablet report, sending...
I20260808 07:05:43.309007 25428 ts_manager.cc:194] Registered new tserver with Master: 8433043122744b97b7634e17dcbfacb9 (127.26.23.130:46687)
I20260808 07:05:43.309340 25428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.130:55169
I20260808 07:05:43.309804 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 25731
I20260808 07:05:43.309906 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal/instance
I20260808 07:05:43.310081 26718 external_mini_cluster.cc:1428] Setting key de4d4c184a3408b6864f3b2f51c7d6f0
I20260808 07:05:43.310905 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.23.131:0
--local_ip_for_outbound_sockets=127.26.23.131
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:44463
--builtin_ntp_servers=127.26.23.148:35185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 07:05:43.390815 25959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:43.391005 25959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:43.391026 25959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:43.392112 25959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:43.392140 25959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:43.392163 25959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.23.131
I20260808 07:05:43.393456 25959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.23.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.23.131
--webserver_port=0
--tserver_master_addrs=127.26.23.190:44463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.23.131
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:43.393643 25959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:43.393926 25959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:43.398710 25969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:43.398798 25967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:43.398733 25971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:43.398861 25959 server_base.cc:1034] running on GCE node
I20260808 07:05:43.399124 25959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:43.399326 25959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:43.400470 25959 hybrid_clock.cc:648] HybridClock initialized: now 1786172743400454 us; error 27 us; skew 500 ppm
I20260808 07:05:43.401669 25959 webserver.cc:460] Webserver started at http://127.26.23.131:35227/ using document root <none> and password file <none>
I20260808 07:05:43.401875 25959 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:43.401923 25959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:43.402050 25959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:43.403113 25959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data/instance:
uuid: "51dc4870bad54863bd068f67fc680a0c"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "4ec754579755bcf1e73b4d30adcb7170"
server_key_iv: "d213ae324467cb5d08dc9ca2830e0109"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.403443 25959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance:
uuid: "51dc4870bad54863bd068f67fc680a0c"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "4ec754579755bcf1e73b4d30adcb7170"
server_key_iv: "d213ae324467cb5d08dc9ca2830e0109"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.404645 25959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:43.405253 25980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.405400 25959 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:43.405483 25959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal
uuid: "51dc4870bad54863bd068f67fc680a0c"
format_stamp: "Formatted at 2026-08-08 07:05:43 on dist-test-slave-zj8q"
server_key: "4ec754579755bcf1e73b4d30adcb7170"
server_key_iv: "d213ae324467cb5d08dc9ca2830e0109"
server_key_version: "encryptionkey@0"
I20260808 07:05:43.405560 25959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:43.420554 25959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:43.420809 25959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:43.420931 25959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:43.421129 25959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 07:05:43.421422 25959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 07:05:43.421455 25959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.421481 25959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 07:05:43.421499 25959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:43.426932 25959 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.131:36917
I20260808 07:05:43.426967 26175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.131:36917 every 8 connection(s)
I20260808 07:05:43.427268 25959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/data/info.pb
I20260808 07:05:43.432237 25493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.428024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.131:54555 (local address 127.26.23.190:44463)
0808 07:05:43.428069 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.428071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.428290 (+ 219us) server_negotiation.cc:407] Connection header received
0808 07:05:43.428780 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.428781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.428795 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.428849 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:43.429505 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.429997 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.431001 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.431196 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.431251 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.431983 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:43.431985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:43.431985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:43.431990 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:43.432007 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:43.432010 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:43.432053 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.432129 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.432157 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:43.432417 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.428001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:44463 (local address 127.26.23.131:54555)
0808 07:05:43.428185 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.428216 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.428687 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.428922 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.428927 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.428936 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:05:43.429417 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.429422 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.430079 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.430080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.430918 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.430921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.431265 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.431265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.431399 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.431852 (+ 453us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 07:05:43.431853 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:05:43.431880 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 07:05:43.431902 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:05:43.432058 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:05:43.432063 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:05:43.432066 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.432127 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.432225 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260808 07:05:43.432823 26176 heartbeater.cc:347] Connected to a master server at 127.26.23.190:44463
I20260808 07:05:43.432895 26176 heartbeater.cc:464] Registering TS with master...
I20260808 07:05:43.433060 26176 heartbeater.cc:511] Master 127.26.23.190:44463 requested a full tablet report, sending...
I20260808 07:05:43.433403 25428 ts_manager.cc:194] Registered new tserver with Master: 51dc4870bad54863bd068f67fc680a0c (127.26.23.131:36917)
I20260808 07:05:43.433763 25428 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.23.131:54555
I20260808 07:05:43.436183 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 25959
I20260808 07:05:43.436266 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal/instance
I20260808 07:05:43.436436 26718 external_mini_cluster.cc:1428] Setting key 64ed7e7dbd7f96dbcd11671a87e15b5a
I20260808 07:05:43.437172 26718 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 07:05:43.440987 25493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.438456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.26.23.190:44463)
0808 07:05:43.438508 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.438510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.438630 (+ 120us) server_negotiation.cc:407] Connection header received
0808 07:05:43.438688 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.438688 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.438698 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.438743 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:43.438875 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.439325 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.440025 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.440227 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.440280 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.440779 (+ 499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:43.440780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:43.440780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:43.440785 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:43.440797 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:43.440801 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:43.440844 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.440897 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.440916 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 07:05:43.442358 25428 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34498:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 07:05:43.443856 25428 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 07:05:43.449574 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.445802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50986 (local address 127.26.23.131:36917)
0808 07:05:43.446292 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.446296 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.446305 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:05:43.446329 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.446331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.446341 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.446407 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:43.446569 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.447319 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.448565 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.449218 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.449278 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.449362 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.449463 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.449496 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":63,"threads_started":1}
I20260808 07:05:43.449574 26195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.445732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:36917 (local address 127.0.0.1:50986)
0808 07:05:43.446047 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.446092 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.446181 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.446427 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.446430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.446432 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:43.446491 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.446493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.447396 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.447397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.448473 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.448476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.449295 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.449296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.449375 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.449390 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.449452 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.449500 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":50,"threads_started":1}
I20260808 07:05:43.449884 26186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.445766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:46687 (local address 127.0.0.1:60184)
0808 07:05:43.446048 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.446091 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.446172 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.446518 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.446519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.446521 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:43.446574 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.446576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.447880 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.447881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.448742 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.448744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.449645 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.449646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.449721 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.449725 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.449778 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.449816 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":38,"thread_start_us":94,"threads_started":1}
I20260808 07:05:43.449931 26192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.445876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60184 (local address 127.26.23.130:46687)
0808 07:05:43.446311 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.446315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.446323 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:43.446361 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.446362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.446377 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.446451 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:43.446651 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.447784 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.448814 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.449448 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.449514 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.449595 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.449802 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.449851 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":91,"threads_started":1}
I20260808 07:05:43.450345 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.445917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:45967 (local address 127.0.0.1:47066)
0808 07:05:43.446056 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.446090 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.446172 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.446518 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.446519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.446524 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:43.446574 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.446576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.447875 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.447877 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.448962 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.448965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.450146 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.450147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.450236 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.450240 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.450274 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.450301 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":31,"thread_start_us":71,"threads_started":1}
I20260808 07:05:43.450316 26073 tablet_service.cc:1467] Processing CreateTablet for tablet d95bcf86866f4f7bbf0d91bf269d8ddb (DEFAULT_TABLE table=test-table [id=48bbcdf011154fb99d52321495f210c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:43.450656 26073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d95bcf86866f4f7bbf0d91bf269d8ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:43.450685 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.446017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47066 (local address 127.26.23.129:45967)
0808 07:05:43.446306 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.446311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.446321 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:43.446360 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.446362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.446377 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.446451 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:43.446664 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.447783 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.449043 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.449872 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.450426 (+ 554us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.450535 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.450562 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.450601 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":154,"threads_started":1}
I20260808 07:05:43.452009 25621 tablet_service.cc:1467] Processing CreateTablet for tablet d95bcf86866f4f7bbf0d91bf269d8ddb (DEFAULT_TABLE table=test-table [id=48bbcdf011154fb99d52321495f210c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:43.452288 25621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d95bcf86866f4f7bbf0d91bf269d8ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:43.453425 26197 tablet_bootstrap.cc:492] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Bootstrap starting.
I20260808 07:05:43.453845 25844 tablet_service.cc:1467] Processing CreateTablet for tablet d95bcf86866f4f7bbf0d91bf269d8ddb (DEFAULT_TABLE table=test-table [id=48bbcdf011154fb99d52321495f210c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 07:05:43.454072 26197 tablet_bootstrap.cc:654] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:43.454106 25844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d95bcf86866f4f7bbf0d91bf269d8ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:43.454424 26197 log.cc:824] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:43.455041 26201 tablet_bootstrap.cc:492] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f: Bootstrap starting.
I20260808 07:05:43.455462 26197 tablet_bootstrap.cc:492] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: No bootstrap required, opened a new log
I20260808 07:05:43.455523 26197 ts_tablet_manager.cc:1397] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:43.455684 26201 tablet_bootstrap.cc:654] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:43.455988 26201 log.cc:824] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:43.456773 26201 tablet_bootstrap.cc:492] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f: No bootstrap required, opened a new log
I20260808 07:05:43.456842 26201 ts_tablet_manager.cc:1397] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 07:05:43.457080 26204 tablet_bootstrap.cc:492] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Bootstrap starting.
I20260808 07:05:43.457738 26204 tablet_bootstrap.cc:654] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:43.457710 26197 raft_consensus.cc:348] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.458025 26197 raft_consensus.cc:374] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:43.458086 26204 log.cc:824] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:43.458084 26197 raft_consensus.cc:729] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51dc4870bad54863bd068f67fc680a0c, State: Initialized, Role: FOLLOWER
I20260808 07:05:43.458242 26197 consensus_queue.cc:260] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.458490 26197 ts_tablet_manager.cc:1428] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:43.458613 26176 heartbeater.cc:503] Master 127.26.23.190:44463 was elected leader, sending a full tablet report...
I20260808 07:05:43.458998 26204 tablet_bootstrap.cc:492] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: No bootstrap required, opened a new log
I20260808 07:05:43.459059 26204 ts_tablet_manager.cc:1397] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 07:05:43.459069 26201 raft_consensus.cc:348] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.459231 26201 raft_consensus.cc:374] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:43.459276 26201 raft_consensus.cc:729] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4d25a83088474abb3ffd4fcf268f2f, State: Initialized, Role: FOLLOWER
I20260808 07:05:43.459389 26201 consensus_queue.cc:260] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.459636 26201 ts_tablet_manager.cc:1428] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 07:05:43.459697 25727 heartbeater.cc:503] Master 127.26.23.190:44463 was elected leader, sending a full tablet report...
I20260808 07:05:43.460970 26204 raft_consensus.cc:348] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.461099 26204 raft_consensus.cc:374] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:43.461133 26204 raft_consensus.cc:729] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8433043122744b97b7634e17dcbfacb9, State: Initialized, Role: FOLLOWER
I20260808 07:05:43.461233 26204 consensus_queue.cc:260] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.461442 26204 ts_tablet_manager.cc:1428] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 07:05:43.461493 25955 heartbeater.cc:503] Master 127.26.23.190:44463 was elected leader, sending a full tablet report...
I20260808 07:05:43.521978 26208 raft_consensus.cc:482] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:43.522110 26208 raft_consensus.cc:504] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.522487 26208 leader_election.cc:288] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51dc4870bad54863bd068f67fc680a0c (127.26.23.131:36917), 8433043122744b97b7634e17dcbfacb9 (127.26.23.130:46687)
I20260808 07:05:43.526305 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.522713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:56215 (local address 127.26.23.131:36917)
0808 07:05:43.522760 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.522762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.522908 (+ 146us) server_negotiation.cc:407] Connection header received
0808 07:05:43.522939 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.522940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.522951 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.522997 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:43.523162 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.523929 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.525337 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.525920 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.525996 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.526005 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.526190 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.526227 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 07:05:43.526305 26192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.522780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.26.23.129:60893 (local address 127.26.23.130:46687)
0808 07:05:43.522836 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.522839 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.522846 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:05:43.522872 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.522873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.522881 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.522935 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 07:05:43.523132 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.523894 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.525338 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.525920 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.525995 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.526005 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.526186 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.526227 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:05:43.526340 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.522643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.130:46687 (local address 127.26.23.129:60893)
0808 07:05:43.522701 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.522714 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.522764 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.522955 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.522956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.522958 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:43.523032 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.523034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.523973 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.523974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.525234 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.525237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.526006 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.526007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.526097 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.526103 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.526183 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.526228 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":39}
I20260808 07:05:43.526348 26212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.522667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.131:36917 (local address 127.26.23.129:56215)
0808 07:05:43.522839 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.522847 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:05:43.522900 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:05:43.523007 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:05:43.523007 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:05:43.523009 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 07:05:43.523082 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.523083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.523994 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.523994 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.525234 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:05:43.525237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.526006 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.526007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:05:43.526097 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.526103 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 07:05:43.526183 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 07:05:43.526227 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":20,"thread_start_us":94,"threads_started":1}
I20260808 07:05:43.526696 25880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95bcf86866f4f7bbf0d91bf269d8ddb" candidate_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8433043122744b97b7634e17dcbfacb9" is_pre_election: true
I20260808 07:05:43.526862 25880 raft_consensus.cc:2454] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4d25a83088474abb3ffd4fcf268f2f in term 0.
I20260808 07:05:43.526973 26111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95bcf86866f4f7bbf0d91bf269d8ddb" candidate_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51dc4870bad54863bd068f67fc680a0c" is_pre_election: true
I20260808 07:05:43.527099 25549 leader_election.cc:302] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8433043122744b97b7634e17dcbfacb9, ea4d25a83088474abb3ffd4fcf268f2f; no voters:
I20260808 07:05:43.527118 26111 raft_consensus.cc:2454] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea4d25a83088474abb3ffd4fcf268f2f in term 0.
I20260808 07:05:43.527227 26208 raft_consensus.cc:2781] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 07:05:43.527307 26208 raft_consensus.cc:482] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 07:05:43.527333 26208 raft_consensus.cc:3037] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:43.528056 26208 raft_consensus.cc:504] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.528245 26208 leader_election.cc:288] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [CANDIDATE]: Term 1 election: Requested vote from peers 51dc4870bad54863bd068f67fc680a0c (127.26.23.131:36917), 8433043122744b97b7634e17dcbfacb9 (127.26.23.130:46687)
I20260808 07:05:43.528331 25880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95bcf86866f4f7bbf0d91bf269d8ddb" candidate_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8433043122744b97b7634e17dcbfacb9"
I20260808 07:05:43.528364 26111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d95bcf86866f4f7bbf0d91bf269d8ddb" candidate_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51dc4870bad54863bd068f67fc680a0c"
I20260808 07:05:43.528429 26111 raft_consensus.cc:3037] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:43.528422 25880 raft_consensus.cc:3037] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:43.529140 26111 raft_consensus.cc:2454] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4d25a83088474abb3ffd4fcf268f2f in term 1.
I20260808 07:05:43.529265 25880 raft_consensus.cc:2454] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea4d25a83088474abb3ffd4fcf268f2f in term 1.
I20260808 07:05:43.529310 25548 leader_election.cc:302] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51dc4870bad54863bd068f67fc680a0c, ea4d25a83088474abb3ffd4fcf268f2f; no voters:
I20260808 07:05:43.529398 26208 raft_consensus.cc:2781] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:43.529567 26208 raft_consensus.cc:686] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [term 1 LEADER]: Becoming Leader. State: Replica: ea4d25a83088474abb3ffd4fcf268f2f, State: Running, Role: LEADER
I20260808 07:05:43.529656 26208 consensus_queue.cc:237] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } }
I20260808 07:05:43.530500 25427 catalog_manager.cc:5495] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f reported cstate change: term changed from 0 to 1, leader changed from <none> to ea4d25a83088474abb3ffd4fcf268f2f (127.26.23.129). New cstate: current_term: 1 leader_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4d25a83088474abb3ffd4fcf268f2f" member_type: VOTER last_known_addr { host: "127.26.23.129" port: 45967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 } health_report { overall_health: UNKNOWN } } }
I20260808 07:05:43.541625 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.539440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47082 (local address 127.26.23.129:45967)
0808 07:05:43.539483 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:43.539485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:43.539495 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:05:43.539536 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:43.539537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:43.539556 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:43.539613 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:05:43.539737 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.540197 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.540917 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:43.541113 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:43.541164 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:43.541309 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:05:43.541405 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:05:43.541475 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:43.541513 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:05:43.541535 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:43.543324 26111 raft_consensus.cc:1261] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 1 FOLLOWER]: Refusing update from remote peer ea4d25a83088474abb3ffd4fcf268f2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:43.543627 25880 raft_consensus.cc:1261] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 1 FOLLOWER]: Refusing update from remote peer ea4d25a83088474abb3ffd4fcf268f2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:05:43.543660 26208 consensus_queue.cc:1035] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "51dc4870bad54863bd068f67fc680a0c" member_type: VOTER last_known_addr { host: "127.26.23.131" port: 36917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:43.543855 26208 consensus_queue.cc:1035] T d95bcf86866f4f7bbf0d91bf269d8ddb P ea4d25a83088474abb3ffd4fcf268f2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8433043122744b97b7634e17dcbfacb9" member_type: VOTER last_known_addr { host: "127.26.23.130" port: 46687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:05:43.546445 26221 mvcc.cc:205] Tried to move back new op lower bound from 7316163557550911488 to 7316163557498097664. Current Snapshot: MvccSnapshot[applied={T|T < 7316163557550911488}]
I20260808 07:05:43.546751 26222 mvcc.cc:205] Tried to move back new op lower bound from 7316163557550911488 to 7316163557498097664. Current Snapshot: MvccSnapshot[applied={T|T < 7316163557550911488}]
I20260808 07:05:43.548460 25427 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:43.548538 25427 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34498:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 07:05:43.549203 25427 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 94c0da5f197344bbac10d1a474fa13c3: Sending DeleteTablet for 3 replicas of tablet d95bcf86866f4f7bbf0d91bf269d8ddb
I20260808 07:05:43.549538 25621 tablet_service.cc:1514] Processing DeleteTablet for tablet d95bcf86866f4f7bbf0d91bf269d8ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:43 UTC) from {username='slave'} at 127.0.0.1:47066
I20260808 07:05:43.549480 26073 tablet_service.cc:1514] Processing DeleteTablet for tablet d95bcf86866f4f7bbf0d91bf269d8ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:43 UTC) from {username='slave'} at 127.0.0.1:50986
I20260808 07:05:43.549773 25844 tablet_service.cc:1514] Processing DeleteTablet for tablet d95bcf86866f4f7bbf0d91bf269d8ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 07:05:43 UTC) from {username='slave'} at 127.0.0.1:60184
I20260808 07:05:43.549847 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 25520
I20260808 07:05:43.558055 26237 tablet_replica.cc:330] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: stopping tablet replica
I20260808 07:05:43.558055 26236 tablet_replica.cc:330] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: stopping tablet replica
I20260808 07:05:43.558207 26237 raft_consensus.cc:2229] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:43.558300 26236 raft_consensus.cc:2229] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 07:05:43.558334 26237 raft_consensus.cc:2258] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:43.558396 26236 raft_consensus.cc:2258] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 07:05:43.559551 26236 ts_tablet_manager.cc:1905] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:43.561316 26237 ts_tablet_manager.cc:1905] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 07:05:43.561442 26236 ts_tablet_manager.cc:1918] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:43.561522 26236 log.cc:1196] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-2/wal/wals/d95bcf86866f4f7bbf0d91bf269d8ddb
I20260808 07:05:43.561774 26236 ts_tablet_manager.cc:1939] T d95bcf86866f4f7bbf0d91bf269d8ddb P 51dc4870bad54863bd068f67fc680a0c: Deleting consensus metadata
I20260808 07:05:43.562215 25406 catalog_manager.cc:4841] TS 51dc4870bad54863bd068f67fc680a0c (127.26.23.131:36917): tablet d95bcf86866f4f7bbf0d91bf269d8ddb (table test-table [id=48bbcdf011154fb99d52321495f210c6]) successfully deleted
I20260808 07:05:43.562860 26237 ts_tablet_manager.cc:1918] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 07:05:43.562935 26237 log.cc:1196] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Deleting WAL directory at /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786172503363962-26718-0/minicluster-data/ts-1/wal/wals/d95bcf86866f4f7bbf0d91bf269d8ddb
I20260808 07:05:43.563176 26237 ts_tablet_manager.cc:1939] T d95bcf86866f4f7bbf0d91bf269d8ddb P 8433043122744b97b7634e17dcbfacb9: Deleting consensus metadata
I20260808 07:05:43.563572 25407 catalog_manager.cc:4841] TS 8433043122744b97b7634e17dcbfacb9 (127.26.23.130:46687): tablet d95bcf86866f4f7bbf0d91bf269d8ddb (table test-table [id=48bbcdf011154fb99d52321495f210c6]) successfully deleted
W20260808 07:05:43.564465 25406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.26.23.129:45967 (error 108)
I20260808 07:05:43.564670 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 25731
I20260808 07:05:43.566845 26189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:43.564830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.129:45967 (local address 127.0.0.1:47098)
0808 07:05:43.566744 (+ 1914us) negotiation.cc:107] Waiting for socket to connect
0808 07:05:43.566813 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.129:45967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1886}
W20260808 07:05:43.570117 25406 catalog_manager.cc:4584] TS ea4d25a83088474abb3ffd4fcf268f2f (127.26.23.129:45967): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d95bcf86866f4f7bbf0d91bf269d8ddb: Network error: Client connection negotiation failed: client connection to 127.26.23.129:45967: connect: Connection refused (error 111)
I20260808 07:05:43.577421 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 25959
I20260808 07:05:43.587707 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 25381
2026-08-08T07:05:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (721 ms)
[----------] 6 tests from EncryptionPolicyTest (8612 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:43 dist-test-slave-zj8q krb5kdc[26242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:43 dist-test-slave-zj8q krb5kdc[26242](info): set up 2 sockets
Aug 08 07:05:43 dist-test-slave-zj8q krb5kdc[26242](info): commencing operation
krb5kdc: starting...
W20260808 07:05:44.731186 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:44 dist-test-slave-zj8q krb5kdc[26242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:44.842656 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:44.922880 26266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:44.923071 26266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:44.923094 26266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:44.924203 26266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:44.924244 26266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:44.924257 26266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:44.924269 26266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:44.924293 26266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:44.925755 26266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43927
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:44.925971 26266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:44.926213 26266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:44.930845 26276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:44.930871 26275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:44.930845 26282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:44.930950 26266 server_base.cc:1034] running on GCE node
I20260808 07:05:44.931300 26266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:44.931551 26266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:44.932698 26266 hybrid_clock.cc:648] HybridClock initialized: now 1786172744932686 us; error 28 us; skew 500 ppm
Aug 08 07:05:44 dist-test-slave-zj8q krb5kdc[26242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:44.935084 26266 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:44.935472 26266 webserver.cc:460] Webserver started at http://127.0.0.1:33503/ using document root <none> and password file <none>
I20260808 07:05:44.935689 26266 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:44.935740 26266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:44.935861 26266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:44.936898 26266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "c9facdeb79ec445896c6c45f42cf7aca"
format_stamp: "Formatted at 2026-08-08 07:05:44 on dist-test-slave-zj8q"
server_key: "a305899bfba28f5a6ec0d748bb74e467"
server_key_iv: "94be4cb30dbc602feeab60bf4aee7b5d"
server_key_version: "encryptionkey@0"
I20260808 07:05:44.937223 26266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "c9facdeb79ec445896c6c45f42cf7aca"
format_stamp: "Formatted at 2026-08-08 07:05:44 on dist-test-slave-zj8q"
server_key: "a305899bfba28f5a6ec0d748bb74e467"
server_key_iv: "94be4cb30dbc602feeab60bf4aee7b5d"
server_key_version: "encryptionkey@0"
I20260808 07:05:44.938477 26266 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:44.939182 26294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:44.939342 26266 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:44.939440 26266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "c9facdeb79ec445896c6c45f42cf7aca"
format_stamp: "Formatted at 2026-08-08 07:05:44 on dist-test-slave-zj8q"
server_key: "a305899bfba28f5a6ec0d748bb74e467"
server_key_iv: "94be4cb30dbc602feeab60bf4aee7b5d"
server_key_version: "encryptionkey@0"
I20260808 07:05:44.939507 26266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:44.959730 26266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:44.961392 26266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:44.961531 26266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:44.965273 26266 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43927
I20260808 07:05:44.965309 26385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43927 every 8 connection(s)
I20260808 07:05:44.965680 26266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:44.966533 26386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:44.967041 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 26266
I20260808 07:05:44.967144 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:44.967314 26718 external_mini_cluster.cc:1428] Setting key 892fa3b1d188a57044eafd62915ece4d
I20260808 07:05:44.969269 26386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca: Bootstrap starting.
I20260808 07:05:44.969831 26386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:44.970090 26386 log.cc:824] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:44.970849 26386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca: No bootstrap required, opened a new log
I20260808 07:05:44.973126 26386 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9facdeb79ec445896c6c45f42cf7aca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260808 07:05:44.973277 26386 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:44.973301 26386 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9facdeb79ec445896c6c45f42cf7aca, State: Initialized, Role: FOLLOWER
I20260808 07:05:44.973405 26386 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9facdeb79ec445896c6c45f42cf7aca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260808 07:05:44.973475 26386 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:44.973496 26386 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:44.973539 26386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 0 FOLLOWER]: Advancing to term 1
Aug 08 07:05:44 dist-test-slave-zj8q krb5kdc[26242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:05:44.974066 26386 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9facdeb79ec445896c6c45f42cf7aca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260808 07:05:44.974184 26386 leader_election.cc:302] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9facdeb79ec445896c6c45f42cf7aca; no voters:
I20260808 07:05:44.974341 26386 leader_election.cc:288] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:44.974377 26397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:44.974540 26397 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [term 1 LEADER]: Becoming Leader. State: Replica: c9facdeb79ec445896c6c45f42cf7aca, State: Running, Role: LEADER
I20260808 07:05:44.974589 26386 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:44.974630 26397 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9facdeb79ec445896c6c45f42cf7aca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } }
I20260808 07:05:44.974964 26397 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9facdeb79ec445896c6c45f42cf7aca. Latest consensus state: current_term: 1 leader_uuid: "c9facdeb79ec445896c6c45f42cf7aca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9facdeb79ec445896c6c45f42cf7aca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } } }
I20260808 07:05:44.975042 26397 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:44.975116 26402 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9facdeb79ec445896c6c45f42cf7aca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9facdeb79ec445896c6c45f42cf7aca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43927 } } }
I20260808 07:05:44.975216 26402 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:44.975338 26411 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:44.975821 26411 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:44.977541 26411 catalog_manager.cc:1347] Generated new cluster ID: 52503cebe64a43edb873c3982db399ce
I20260808 07:05:44.977584 26411 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:44.978140 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:44.967811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53625 (local address 127.0.0.1:43927)
0808 07:05:44.967967 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:44.967974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:44.967998 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:05:44.968390 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:44.968397 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:44.968439 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:44.968546 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:44.969309 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:44.970271 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:44.971212 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:44.971601 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:44.971683 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:44.974251 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:44.974255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:44.974255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:44.974267 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:44.976214 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:44.976604 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:44.976607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:44.976607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:44.976711 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:44.976973 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:44.976974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:44.976974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:44.977269 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:44.977427 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:44.977843 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 07:05:44.977944 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":67,"threads_started":1}
I20260808 07:05:44.979007 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:44.986603 26411 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:44.987176 26411 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:44.987488 26395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:44.980426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56811 (local address 127.0.0.1:43927)
0808 07:05:44.980458 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:44.980459 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:44.980522 (+ 63us) server_negotiation.cc:407] Connection header received
0808 07:05:44.980575 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:44.980575 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:44.980585 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:44.980648 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:44.981179 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:44.981883 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:44.982832 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:44.983190 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:44.983261 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:44.984459 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:44.984461 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:44.984461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:44.984468 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:44.985899 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:44.986537 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:44.986538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:44.986538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:44.986598 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:44.986926 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:44.986927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:44.986927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:44.987080 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:44.987192 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:44.987335 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:05:44.987400 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":17}
I20260808 07:05:44.990840 26411 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9facdeb79ec445896c6c45f42cf7aca: Generated new TSK 0
I20260808 07:05:44.990984 26411 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:44.995960 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 26266
W20260808 07:05:45.010910 26240 connection.cc:535] client connection to 127.0.0.1:43927 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43927): Connection reset by peer (error 104)
2026-08-08T07:05:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:45 dist-test-slave-zj8q krb5kdc[26450](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:45 dist-test-slave-zj8q krb5kdc[26450](info): set up 2 sockets
Aug 08 07:05:45 dist-test-slave-zj8q krb5kdc[26450](info): commencing operation
krb5kdc: starting...
W20260808 07:05:46.152784 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:46 dist-test-slave-zj8q krb5kdc[26450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172746, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:46.269021 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38847
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40463
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:46.349005 26475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:46.349200 26475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:46.349231 26475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:46.350363 26475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:46.350401 26475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:46.350418 26475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:46.350435 26475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:46.350448 26475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:46.351908 26475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40463
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38847
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:46.352138 26475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:46.352344 26475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:46.356977 26484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:46.357009 26483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:46.357116 26489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:46.357213 26475 server_base.cc:1034] running on GCE node
I20260808 07:05:46.357436 26475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:46.357753 26475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:46.358903 26475 hybrid_clock.cc:648] HybridClock initialized: now 1786172746358883 us; error 34 us; skew 500 ppm
Aug 08 07:05:46 dist-test-slave-zj8q krb5kdc[26450](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172746, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:46.361214 26475 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:46.361599 26475 webserver.cc:460] Webserver started at http://127.0.0.1:42329/ using document root <none> and password file <none>
I20260808 07:05:46.361816 26475 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:46.361865 26475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:46.361989 26475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:46.363121 26475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "04bb7b0585fc4abebae4d6f447bfaec7"
format_stamp: "Formatted at 2026-08-08 07:05:46 on dist-test-slave-zj8q"
server_key: "f2df5a31ea963bd4ced23f98921e6820"
server_key_iv: "f97f743ef53f8969006c93c594ceda98"
server_key_version: "encryptionkey@0"
I20260808 07:05:46.363441 26475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "04bb7b0585fc4abebae4d6f447bfaec7"
format_stamp: "Formatted at 2026-08-08 07:05:46 on dist-test-slave-zj8q"
server_key: "f2df5a31ea963bd4ced23f98921e6820"
server_key_iv: "f97f743ef53f8969006c93c594ceda98"
server_key_version: "encryptionkey@0"
I20260808 07:05:46.364671 26475 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:46.365314 26506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:46.365459 26475 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:46.365554 26475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "04bb7b0585fc4abebae4d6f447bfaec7"
format_stamp: "Formatted at 2026-08-08 07:05:46 on dist-test-slave-zj8q"
server_key: "f2df5a31ea963bd4ced23f98921e6820"
server_key_iv: "f97f743ef53f8969006c93c594ceda98"
server_key_version: "encryptionkey@0"
I20260808 07:05:46.365664 26475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:46.374775 26475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:46.376333 26475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:46.376458 26475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:46.380213 26475 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38847
I20260808 07:05:46.380246 26598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38847 every 8 connection(s)
I20260808 07:05:46.380541 26475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:46.381359 26599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:46.383369 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 26475
I20260808 07:05:46.383467 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:46.383584 26599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7: Bootstrap starting.
I20260808 07:05:46.383631 26718 external_mini_cluster.cc:1428] Setting key d8f5701bc0bc11fee4f815b2b834420a
I20260808 07:05:46.384264 26599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:46.384593 26599 log.cc:824] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:46.385308 26599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7: No bootstrap required, opened a new log
I20260808 07:05:46.387549 26599 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260808 07:05:46.387713 26599 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:46.387748 26599 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04bb7b0585fc4abebae4d6f447bfaec7, State: Initialized, Role: FOLLOWER
I20260808 07:05:46.387869 26599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260808 07:05:46.387941 26599 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:46.387977 26599 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:46.388025 26599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:46.388607 26599 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260808 07:05:46.388701 26599 leader_election.cc:302] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04bb7b0585fc4abebae4d6f447bfaec7; no voters:
I20260808 07:05:46.388857 26599 leader_election.cc:288] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:46.388896 26604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:46.389042 26604 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [term 1 LEADER]: Becoming Leader. State: Replica: 04bb7b0585fc4abebae4d6f447bfaec7, State: Running, Role: LEADER
I20260808 07:05:46.389113 26599 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:46.389190 26604 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260808 07:05:46.389555 26604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04bb7b0585fc4abebae4d6f447bfaec7. Latest consensus state: current_term: 1 leader_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } } }
I20260808 07:05:46.389644 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:46.384088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48277 (local address 127.0.0.1:38847)
0808 07:05:46.384290 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:46.384300 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:46.384332 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:05:46.384893 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:46.384901 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:46.384947 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:46.385087 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:46.385246 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:46.386675 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:46.387422 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:46.388023 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:46.388130 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:46.388757 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:46.388761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:46.388761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:46.388957 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:46.388997 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:46.389012 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:46.389359 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:46.389404 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 07:05:46.389432 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":73,"threads_started":1}
I20260808 07:05:46.389664 26607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04bb7b0585fc4abebae4d6f447bfaec7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } } }
I20260808 07:05:46.389753 26607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:46.389958 26619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:46.390026 26604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:46.390486 26619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:46.390714 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:46.393272 26619 catalog_manager.cc:1347] Generated new cluster ID: 3a730bcb57cd42e6abcdc148e31a7452
I20260808 07:05:46.393328 26619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:46.395444 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:46.392192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40569 (local address 127.0.0.1:38847)
0808 07:05:46.392227 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:46.392229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:46.392388 (+ 159us) server_negotiation.cc:407] Connection header received
0808 07:05:46.392443 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:46.392444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:46.392452 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:46.392496 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:46.392618 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:46.393192 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:46.394221 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:46.394534 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:46.394607 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:46.395213 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:46.395215 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:46.395215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:46.395219 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:46.395235 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:46.395240 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:46.395302 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:46.395362 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 07:05:46.395372 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:46.399362 26619 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:46.400049 26619 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:46.406304 26619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04bb7b0585fc4abebae4d6f447bfaec7: Generated new TSK 0
I20260808 07:05:46.406455 26619 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:46.413740 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 26475
W20260808 07:05:46.437312 26446 connection.cc:535] client connection to 127.0.0.1:38847 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38847): Connection reset by peer (error 104)
2026-08-08T07:05:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:46 dist-test-slave-zj8q krb5kdc[26649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:46 dist-test-slave-zj8q krb5kdc[26649](info): set up 2 sockets
Aug 08 07:05:46 dist-test-slave-zj8q krb5kdc[26649](info): commencing operation
krb5kdc: starting...
W20260808 07:05:47.572203 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:47 dist-test-slave-zj8q krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:47.688977 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41103
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41103
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:47.769586 26668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:47.769789 26668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:47.769819 26668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:47.771010 26668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:47.771061 26668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:47.771080 26668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:47.771095 26668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:47.771111 26668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:47.772605 26668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41103
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:47.772850 26668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:47.773054 26668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:47.777770 26681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:47.777779 26684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:47.777793 26678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:47.777798 26668 server_base.cc:1034] running on GCE node
I20260808 07:05:47.778245 26668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:47.778498 26668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:47.779647 26668 hybrid_clock.cc:648] HybridClock initialized: now 1786172747779635 us; error 30 us; skew 500 ppm
Aug 08 07:05:47 dist-test-slave-zj8q krb5kdc[26649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:47.782053 26668 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:47.782471 26668 webserver.cc:460] Webserver started at http://127.0.0.1:39505/ using document root <none> and password file <none>
I20260808 07:05:47.782660 26668 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:47.782701 26668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:47.782792 26668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:47.783810 26668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "528b9ec7db8d44119ab3aab3cf9b7417"
format_stamp: "Formatted at 2026-08-08 07:05:47 on dist-test-slave-zj8q"
server_key: "466bbef5d7b2e68e8c1152652746c263"
server_key_iv: "b226ec6258ec84a915e6a7e05ce13995"
server_key_version: "encryptionkey@0"
I20260808 07:05:47.784118 26668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "528b9ec7db8d44119ab3aab3cf9b7417"
format_stamp: "Formatted at 2026-08-08 07:05:47 on dist-test-slave-zj8q"
server_key: "466bbef5d7b2e68e8c1152652746c263"
server_key_iv: "b226ec6258ec84a915e6a7e05ce13995"
server_key_version: "encryptionkey@0"
I20260808 07:05:47.785300 26668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:47.785961 26695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:47.786140 26668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:47.786250 26668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "528b9ec7db8d44119ab3aab3cf9b7417"
format_stamp: "Formatted at 2026-08-08 07:05:47 on dist-test-slave-zj8q"
server_key: "466bbef5d7b2e68e8c1152652746c263"
server_key_iv: "b226ec6258ec84a915e6a7e05ce13995"
server_key_version: "encryptionkey@0"
I20260808 07:05:47.786319 26668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:47.789390 26668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:47.791226 26668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:47.791342 26668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:47.795117 26668 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41103
I20260808 07:05:47.795164 26789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41103 every 8 connection(s)
I20260808 07:05:47.795430 26668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:47.796351 26790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:47.798877 26790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417: Bootstrap starting.
I20260808 07:05:47.799429 26790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:47.799696 26790 log.cc:824] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:47.800331 26790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417: No bootstrap required, opened a new log
I20260808 07:05:47.801939 26790 raft_consensus.cc:348] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260808 07:05:47.802085 26790 raft_consensus.cc:374] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:47.802124 26790 raft_consensus.cc:729] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 528b9ec7db8d44119ab3aab3cf9b7417, State: Initialized, Role: FOLLOWER
I20260808 07:05:47.802315 26790 consensus_queue.cc:260] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260808 07:05:47.802395 26790 raft_consensus.cc:388] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:47.802429 26790 raft_consensus.cc:482] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:47.802477 26790 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:47.802991 26790 raft_consensus.cc:504] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260808 07:05:47.803086 26790 leader_election.cc:302] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 528b9ec7db8d44119ab3aab3cf9b7417; no voters:
I20260808 07:05:47.803246 26790 leader_election.cc:288] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:47.803296 26796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:47.803419 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 26668
I20260808 07:05:47.803440 26796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [term 1 LEADER]: Becoming Leader. State: Replica: 528b9ec7db8d44119ab3aab3cf9b7417, State: Running, Role: LEADER
I20260808 07:05:47.803534 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:47.803524 26790 sys_catalog.cc:564] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:47.803521 26796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } }
I20260808 07:05:47.803735 26718 external_mini_cluster.cc:1428] Setting key 6c4194dffd98cca4a63b784f0d6ce849
I20260808 07:05:47.803838 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 528b9ec7db8d44119ab3aab3cf9b7417. Latest consensus state: current_term: 1 leader_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } } }
I20260808 07:05:47.803905 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:47.803985 26801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "528b9ec7db8d44119ab3aab3cf9b7417" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41103 } } }
I20260808 07:05:47.804157 26801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417 [sys.catalog]: This master's current role is: LEADER
W20260808 07:05:47.805365 26829 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:47.805444 26829 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:47.805671 26810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:47.805881 26810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:47.806330 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:47.804458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47085 (local address 127.0.0.1:41103)
0808 07:05:47.804651 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:47.804661 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:47.804697 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:05:47.804824 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:47.804832 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:47.804874 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:47.805358 (+ 484us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:47.805832 (+ 474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:47.805836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:47.805836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:47.805840 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:47.805885 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:47.805900 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:47.806000 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:47.806090 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:05:47.806136 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":82,"threads_started":1}
I20260808 07:05:47.807365 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:47.807394 26810 catalog_manager.cc:1347] Generated new cluster ID: d66e6242ac7a46d793891cd6f09c0d3a
I20260808 07:05:47.807432 26810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:47.809779 26817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:47.808831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42577 (local address 127.0.0.1:41103)
0808 07:05:47.808864 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:47.808866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:47.808989 (+ 123us) server_negotiation.cc:407] Connection header received
0808 07:05:47.809036 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:47.809037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:47.809041 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:47.809105 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:47.809570 (+ 465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:47.809571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:47.809572 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:47.809575 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:47.809590 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:47.809594 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:47.809647 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:47.809696 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 07:05:47.809707 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:05:47.822544 26810 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:47.822697 26810 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:47.827122 26810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 528b9ec7db8d44119ab3aab3cf9b7417: Generated new TSK 0
I20260808 07:05:47.827280 26810 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:47.834298 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 26668
2026-08-08T07:05:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:47 dist-test-slave-zj8q krb5kdc[26848](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:47 dist-test-slave-zj8q krb5kdc[26848](info): set up 2 sockets
Aug 08 07:05:47 dist-test-slave-zj8q krb5kdc[26848](info): commencing operation
krb5kdc: starting...
W20260808 07:05:48.974922 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:49 dist-test-slave-zj8q krb5kdc[26848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:49.090266 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:49.171099 26868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:49.171293 26868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:49.171314 26868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:49.172358 26868 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:49.172391 26868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:49.172405 26868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:49.172415 26868 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:49.172426 26868 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:49.173811 26868 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:49.173990 26868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:49.174147 26868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:49.178818 26876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:49.178858 26879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:49.178861 26875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:49.178944 26868 server_base.cc:1034] running on GCE node
I20260808 07:05:49.179265 26868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:49.179536 26868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:49.180672 26868 hybrid_clock.cc:648] HybridClock initialized: now 1786172749180654 us; error 36 us; skew 500 ppm
Aug 08 07:05:49 dist-test-slave-zj8q krb5kdc[26848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172749, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:49.183003 26868 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:49.183414 26868 webserver.cc:460] Webserver started at http://127.0.0.1:43837/ using document root <none> and password file <none>
I20260808 07:05:49.183602 26868 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:49.183645 26868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:49.183771 26868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:49.184782 26868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "d958945d6564491885cee2921c4d43e9"
format_stamp: "Formatted at 2026-08-08 07:05:49 on dist-test-slave-zj8q"
server_key: "ece2accfcd9cae61efa2e95103e77c40"
server_key_iv: "59c8b571e6a5c2bcef8fea3a3aad323a"
server_key_version: "encryptionkey@0"
I20260808 07:05:49.185097 26868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "d958945d6564491885cee2921c4d43e9"
format_stamp: "Formatted at 2026-08-08 07:05:49 on dist-test-slave-zj8q"
server_key: "ece2accfcd9cae61efa2e95103e77c40"
server_key_iv: "59c8b571e6a5c2bcef8fea3a3aad323a"
server_key_version: "encryptionkey@0"
I20260808 07:05:49.186350 26868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:49.187044 26889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:49.187232 26868 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:49.187322 26868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "d958945d6564491885cee2921c4d43e9"
format_stamp: "Formatted at 2026-08-08 07:05:49 on dist-test-slave-zj8q"
server_key: "ece2accfcd9cae61efa2e95103e77c40"
server_key_iv: "59c8b571e6a5c2bcef8fea3a3aad323a"
server_key_version: "encryptionkey@0"
I20260808 07:05:49.187376 26868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:49.198029 26868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:49.200008 26868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:49.200124 26868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:49.203886 26868 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42937
I20260808 07:05:49.203933 26976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42937 every 8 connection(s)
I20260808 07:05:49.204234 26868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:49.204993 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 26868
I20260808 07:05:49.205093 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:49.205179 26978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:49.205300 26718 external_mini_cluster.cc:1428] Setting key c6c886e5e7b6844bc588c37b29cd566a
I20260808 07:05:49.207908 26978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9: Bootstrap starting.
I20260808 07:05:49.208467 26978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:49.208737 26978 log.cc:824] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:49.209336 26978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9: No bootstrap required, opened a new log
I20260808 07:05:49.211241 26978 raft_consensus.cc:348] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d958945d6564491885cee2921c4d43e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42937 } }
I20260808 07:05:49.211414 26978 raft_consensus.cc:374] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:49.211450 26978 raft_consensus.cc:729] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d958945d6564491885cee2921c4d43e9, State: Initialized, Role: FOLLOWER
Aug 08 07:05:49 dist-test-slave-zj8q krb5kdc[26848](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:05:49.211575 26978 consensus_queue.cc:260] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d958945d6564491885cee2921c4d43e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42937 } }
I20260808 07:05:49.211671 26978 raft_consensus.cc:388] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:49.211716 26978 raft_consensus.cc:482] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:49.211767 26978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:49.212277 26978 raft_consensus.cc:504] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d958945d6564491885cee2921c4d43e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42937 } }
I20260808 07:05:49.212373 26978 leader_election.cc:302] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d958945d6564491885cee2921c4d43e9; no voters:
I20260808 07:05:49.212533 26978 leader_election.cc:288] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:49.212569 26984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:49.212739 26984 raft_consensus.cc:686] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [term 1 LEADER]: Becoming Leader. State: Replica: d958945d6564491885cee2921c4d43e9, State: Running, Role: LEADER
I20260808 07:05:49.212800 26978 sys_catalog.cc:564] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:49.212903 26984 consensus_queue.cc:237] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d958945d6564491885cee2921c4d43e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42937 } }
I20260808 07:05:49.213236 26984 sys_catalog.cc:455] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d958945d6564491885cee2921c4d43e9. Latest consensus state: current_term: 1 leader_uuid: "d958945d6564491885cee2921c4d43e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d958945d6564491885cee2921c4d43e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42937 } } }
I20260808 07:05:49.213320 26984 sys_catalog.cc:458] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:49.213464 26987 sys_catalog.cc:455] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d958945d6564491885cee2921c4d43e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d958945d6564491885cee2921c4d43e9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42937 } } }
I20260808 07:05:49.213537 26987 sys_catalog.cc:458] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:49.213649 27000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:49.214174 27000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:49.215772 27000 catalog_manager.cc:1347] Generated new cluster ID: 20eb1a46ebe1436abee7d3d8bdf869fc
I20260808 07:05:49.215847 27000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:49.215925 26982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:49.205798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45943 (local address 127.0.0.1:42937)
0808 07:05:49.206000 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:49.206008 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:49.206031 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:05:49.206547 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:49.206555 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:49.206604 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:49.206724 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:49.207338 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:49.208273 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:49.209107 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:49.209548 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:49.209640 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:49.212081 (+ 2441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:49.212086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:49.212086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:49.212098 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:49.214121 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:49.214644 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:49.214647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:49.214647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:49.214749 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:49.214969 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:49.214970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:49.214971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:49.215241 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:49.215380 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:49.215530 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 07:05:49.215678 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":99,"threads_started":1}
I20260808 07:05:49.216842 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:49.224771 26982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:49.218208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36605 (local address 127.0.0.1:42937)
0808 07:05:49.218291 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:49.218293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:49.218344 (+ 51us) server_negotiation.cc:407] Connection header received
0808 07:05:49.218410 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:49.218411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:49.218420 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:49.218462 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:49.219024 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:49.219773 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:49.220730 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:49.221047 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:49.221119 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:49.222346 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:49.222347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:49.222348 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:49.222354 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:49.223732 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:49.224059 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:49.224060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:49.224061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:49.224105 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:49.224271 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:49.224271 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:49.224272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:49.224375 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:49.224434 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:49.224606 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 07:05:49.224685 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 07:05:49.243515 27000 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:49.244274 27000 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:49.249573 27000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d958945d6564491885cee2921c4d43e9: Generated new TSK 0
I20260808 07:05:49.249758 27000 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:49.260191 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 26868
2026-08-08T07:05:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1423 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:49 dist-test-slave-zj8q krb5kdc[27033](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:49 dist-test-slave-zj8q krb5kdc[27033](info): set up 2 sockets
Aug 08 07:05:49 dist-test-slave-zj8q krb5kdc[27033](info): commencing operation
krb5kdc: starting...
W20260808 07:05:50.406132 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:50 dist-test-slave-zj8q krb5kdc[27033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:50.521445 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:50.603829 27056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:50.604032 27056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:50.604054 27056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:50.605139 27056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:50.605176 27056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:50.605188 27056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:50.605201 27056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:50.605217 27056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:50.606680 27056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46583
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:50.606875 27056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:50.607049 27056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 07:05:50.611822 27056 server_base.cc:1034] running on GCE node
W20260808 07:05:50.611800 27067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:50.611837 27064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:50.611804 27063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:50.612313 27056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:50.612601 27056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:50.613755 27056 hybrid_clock.cc:648] HybridClock initialized: now 1786172750613739 us; error 34 us; skew 500 ppm
Aug 08 07:05:50 dist-test-slave-zj8q krb5kdc[27033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172750, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:50.619206 27056 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:50.619642 27056 webserver.cc:460] Webserver started at http://127.0.0.1:38429/ using document root <none> and password file <none>
I20260808 07:05:50.619851 27056 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:50.619899 27056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:50.620021 27056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:50.621057 27056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "add1e7852ffb44cab689362b5b14f8de"
format_stamp: "Formatted at 2026-08-08 07:05:50 on dist-test-slave-zj8q"
server_key: "433f5d1ac28f9c79955fc05100ec3fed"
server_key_iv: "fdb751c7c24e9c2fb6ef77666c8753d1"
server_key_version: "encryptionkey@0"
I20260808 07:05:50.621383 27056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "add1e7852ffb44cab689362b5b14f8de"
format_stamp: "Formatted at 2026-08-08 07:05:50 on dist-test-slave-zj8q"
server_key: "433f5d1ac28f9c79955fc05100ec3fed"
server_key_iv: "fdb751c7c24e9c2fb6ef77666c8753d1"
server_key_version: "encryptionkey@0"
I20260808 07:05:50.622673 27056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:05:50.623323 27075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:50.623467 27056 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:50.623550 27056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "add1e7852ffb44cab689362b5b14f8de"
format_stamp: "Formatted at 2026-08-08 07:05:50 on dist-test-slave-zj8q"
server_key: "433f5d1ac28f9c79955fc05100ec3fed"
server_key_iv: "fdb751c7c24e9c2fb6ef77666c8753d1"
server_key_version: "encryptionkey@0"
I20260808 07:05:50.623639 27056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:50.648036 27056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:50.650113 27056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:50.650274 27056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:50.654179 27056 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46583
I20260808 07:05:50.654208 27153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46583 every 8 connection(s)
I20260808 07:05:50.654544 27056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:50.655373 27156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:50.656306 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27056
I20260808 07:05:50.656432 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:50.656654 26718 external_mini_cluster.cc:1428] Setting key 69157730e8a5b653bf75ea7b2ac615c7
I20260808 07:05:50.658027 27156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de: Bootstrap starting.
I20260808 07:05:50.658677 27156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:50.658943 27156 log.cc:824] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:50.659631 27156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de: No bootstrap required, opened a new log
I20260808 07:05:50.662063 27165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:50.657189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53143 (local address 127.0.0.1:46583)
0808 07:05:50.657343 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:50.657350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:50.657373 (+ 23us) server_negotiation.cc:407] Connection header received
0808 07:05:50.657864 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:50.657871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:50.657917 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:50.658027 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:50.658281 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:50.659238 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:50.660045 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:50.660681 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:50.660793 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:50.661392 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:50.661398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:50.661398 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:50.661620 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:50.661663 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:50.661679 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:50.661740 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:50.661800 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 07:05:50.661866 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260808 07:05:50.661973 27156 raft_consensus.cc:348] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260808 07:05:50.662137 27156 raft_consensus.cc:374] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:50.662199 27156 raft_consensus.cc:729] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: add1e7852ffb44cab689362b5b14f8de, State: Initialized, Role: FOLLOWER
I20260808 07:05:50.662351 27156 consensus_queue.cc:260] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260808 07:05:50.662456 27156 raft_consensus.cc:388] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:50.662489 27156 raft_consensus.cc:482] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:50.662554 27156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:50.663049 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:50.663156 27156 raft_consensus.cc:504] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260808 07:05:50.663268 27156 leader_election.cc:302] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: add1e7852ffb44cab689362b5b14f8de; no voters:
I20260808 07:05:50.663286 27167 raft_consensus.cc:482] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 07:05:50.663384 27167 raft_consensus.cc:504] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260808 07:05:50.663452 27156 leader_election.cc:288] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:50.663533 27170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:50.663718 27167 leader_election.cc:302] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: add1e7852ffb44cab689362b5b14f8de; no voters:
I20260808 07:05:50.663726 27170 raft_consensus.cc:686] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [term 1 LEADER]: Becoming Leader. State: Replica: add1e7852ffb44cab689362b5b14f8de, State: Running, Role: LEADER
I20260808 07:05:50.663774 27156 sys_catalog.cc:564] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:50.663834 27170 consensus_queue.cc:237] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } }
I20260808 07:05:50.664139 27170 sys_catalog.cc:455] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [sys.catalog]: SysCatalogTable state changed. Reason: New leader add1e7852ffb44cab689362b5b14f8de. Latest consensus state: current_term: 1 leader_uuid: "add1e7852ffb44cab689362b5b14f8de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } } }
I20260808 07:05:50.664202 27170 sys_catalog.cc:458] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:50.663836 27167 leader_election.cc:288] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers
I20260808 07:05:50.664482 27172 sys_catalog.cc:455] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "add1e7852ffb44cab689362b5b14f8de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "add1e7852ffb44cab689362b5b14f8de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46583 } } }
I20260808 07:05:50.664546 27172 sys_catalog.cc:458] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:50.664877 27189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:50.665338 27189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:50.667186 27189 catalog_manager.cc:1347] Generated new cluster ID: f7230ee2af364bb7af410bcc59abd724
I20260808 07:05:50.667243 27189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:50.669297 27165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:50.666075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49305 (local address 127.0.0.1:46583)
0808 07:05:50.666112 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:50.666114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:50.666179 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:05:50.666278 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:50.666279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:50.666289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:50.666316 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:50.666492 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:50.667120 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:50.668114 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:50.668394 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:50.668427 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:50.669072 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:50.669074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:50.669074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:50.669078 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:50.669091 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:50.669095 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:50.669118 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:50.669207 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:05:50.669229 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:05:50.687435 27189 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:50.688171 27189 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:50.693861 27189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P add1e7852ffb44cab689362b5b14f8de: Generated new TSK 0
I20260808 07:05:50.694036 27189 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:50.696209 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27056
2026-08-08T07:05:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:50 dist-test-slave-zj8q krb5kdc[27212](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:50 dist-test-slave-zj8q krb5kdc[27212](info): set up 2 sockets
Aug 08 07:05:50 dist-test-slave-zj8q krb5kdc[27212](info): commencing operation
krb5kdc: starting...
W20260808 07:05:51.852223 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:51 dist-test-slave-zj8q krb5kdc[27212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:51.964512 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36331
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:52.048775 27238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:52.048981 27238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:52.049012 27238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:52.050125 27238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:52.050191 27238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:52.050213 27238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:52.050239 27238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:52.050257 27238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:52.051748 27238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:52.051992 27238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:52.052197 27238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:52.056872 27254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:52.056994 27238 server_base.cc:1034] running on GCE node
W20260808 07:05:52.056891 27246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:52.057076 27251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:52.057363 27238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:52.057636 27238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:52.058784 27238 hybrid_clock.cc:648] HybridClock initialized: now 1786172752058771 us; error 30 us; skew 500 ppm
Aug 08 07:05:52 dist-test-slave-zj8q krb5kdc[27212](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172752, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:52.061234 27238 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:52.061625 27238 webserver.cc:460] Webserver started at http://127.0.0.1:45995/ using document root <none> and password file <none>
I20260808 07:05:52.061816 27238 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:52.061862 27238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:52.061985 27238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:52.063031 27238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "b55c03d80bf143bb9a1c6b2350a2024c"
format_stamp: "Formatted at 2026-08-08 07:05:52 on dist-test-slave-zj8q"
server_key: "c0536e50433207ad2a8cff3292210874"
server_key_iv: "edc39d13e24bf8d6ac2004fc86b570cd"
server_key_version: "encryptionkey@0"
I20260808 07:05:52.063382 27238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "b55c03d80bf143bb9a1c6b2350a2024c"
format_stamp: "Formatted at 2026-08-08 07:05:52 on dist-test-slave-zj8q"
server_key: "c0536e50433207ad2a8cff3292210874"
server_key_iv: "edc39d13e24bf8d6ac2004fc86b570cd"
server_key_version: "encryptionkey@0"
I20260808 07:05:52.064611 27238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:52.065255 27263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:52.065399 27238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:52.065486 27238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "b55c03d80bf143bb9a1c6b2350a2024c"
format_stamp: "Formatted at 2026-08-08 07:05:52 on dist-test-slave-zj8q"
server_key: "c0536e50433207ad2a8cff3292210874"
server_key_iv: "edc39d13e24bf8d6ac2004fc86b570cd"
server_key_version: "encryptionkey@0"
I20260808 07:05:52.065559 27238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:52.068895 27238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:52.070684 27238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:52.070806 27238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:52.074564 27238 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36331
I20260808 07:05:52.074594 27340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36331 every 8 connection(s)
I20260808 07:05:52.074898 27238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:52.075825 27341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:52.077955 27341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c: Bootstrap starting.
I20260808 07:05:52.078531 27341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:52.078545 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27238
I20260808 07:05:52.078655 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:52.078821 26718 external_mini_cluster.cc:1428] Setting key ea79447a69182d8700a6d518b80b225e
I20260808 07:05:52.078812 27341 log.cc:824] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:52.079497 27341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c: No bootstrap required, opened a new log
I20260808 07:05:52.081233 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:52.079266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50497 (local address 127.0.0.1:36331)
0808 07:05:52.079446 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:52.079455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:52.079486 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:05:52.079914 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:52.079921 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:52.079947 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:52.080066 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:52.080698 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:52.080702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:52.080702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:52.080706 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:52.080747 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:52.080757 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:52.080828 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:52.080879 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 07:05:52.080916 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260808 07:05:52.081274 27341 raft_consensus.cc:348] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36331 } }
I20260808 07:05:52.081445 27341 raft_consensus.cc:374] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:52.081493 27341 raft_consensus.cc:729] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b55c03d80bf143bb9a1c6b2350a2024c, State: Initialized, Role: FOLLOWER
I20260808 07:05:52.081609 27341 consensus_queue.cc:260] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36331 } }
I20260808 07:05:52.081698 27341 raft_consensus.cc:388] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:52.081780 27341 raft_consensus.cc:482] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:52.081827 27341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:52.082139 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:52.082460 27341 raft_consensus.cc:504] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36331 } }
I20260808 07:05:52.082561 27341 leader_election.cc:302] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b55c03d80bf143bb9a1c6b2350a2024c; no voters:
I20260808 07:05:52.082715 27341 leader_election.cc:288] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:52.082752 27348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:52.082894 27348 raft_consensus.cc:686] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [term 1 LEADER]: Becoming Leader. State: Replica: b55c03d80bf143bb9a1c6b2350a2024c, State: Running, Role: LEADER
I20260808 07:05:52.082940 27341 sys_catalog.cc:564] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:52.083065 27348 consensus_queue.cc:237] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36331 } }
I20260808 07:05:52.083484 27350 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36331 } } }
I20260808 07:05:52.083575 27350 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:52.083810 27351 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55c03d80bf143bb9a1c6b2350a2024c. Latest consensus state: current_term: 1 leader_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b55c03d80bf143bb9a1c6b2350a2024c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36331 } } }
I20260808 07:05:52.083884 27351 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:52.084182 27377 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:52.084717 27377 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:52.086032 27377 catalog_manager.cc:1347] Generated new cluster ID: 20df10a9fe8f4b07bc0044d7beaa1757
I20260808 07:05:52.086082 27377 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:52.086818 27347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:52.083549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40675 (local address 127.0.0.1:36331)
0808 07:05:52.083583 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:52.083585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:52.084195 (+ 610us) server_negotiation.cc:407] Connection header received
0808 07:05:52.084319 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:52.084320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:52.084324 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:52.084351 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:52.086611 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:52.086613 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:52.086613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:52.086617 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:52.086629 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:52.086633 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:52.086659 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:52.086748 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 07:05:52.086759 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:05:52.090691 27377 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:52.090828 27377 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:52.094846 27377 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b55c03d80bf143bb9a1c6b2350a2024c: Generated new TSK 0
I20260808 07:05:52.094993 27377 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:52.099730 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27238
2026-08-08T07:05:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1400 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:52 dist-test-slave-zj8q krb5kdc[27397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:52 dist-test-slave-zj8q krb5kdc[27397](info): set up 2 sockets
Aug 08 07:05:52 dist-test-slave-zj8q krb5kdc[27397](info): commencing operation
krb5kdc: starting...
W20260808 07:05:53.255791 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:53 dist-test-slave-zj8q krb5kdc[27397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:53.372218 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44055
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:53.451974 27417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:53.452196 27417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:53.452224 27417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:53.453307 27417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:53.453344 27417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:53.453356 27417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:53.453367 27417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:53.453378 27417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:53.454843 27417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:53.455029 27417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:53.455204 27417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:53.459729 27423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:53.459720 27433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:53.459820 27429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:53.459874 27417 server_base.cc:1034] running on GCE node
I20260808 07:05:53.460196 27417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:53.460430 27417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:53.461570 27417 hybrid_clock.cc:648] HybridClock initialized: now 1786172753461548 us; error 34 us; skew 500 ppm
Aug 08 07:05:53 dist-test-slave-zj8q krb5kdc[27397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172753, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:53.463966 27417 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:53.464370 27417 webserver.cc:460] Webserver started at http://127.0.0.1:44417/ using document root <none> and password file <none>
I20260808 07:05:53.464579 27417 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:53.464627 27417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:53.464748 27417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:53.465744 27417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "23990fe3285a401abea986ee3de75e4d"
format_stamp: "Formatted at 2026-08-08 07:05:53 on dist-test-slave-zj8q"
server_key: "7d97b0d214c202c1ce0157bc4f7a4cc1"
server_key_iv: "fcac5b0f5fa973f7d163263f97064913"
server_key_version: "encryptionkey@0"
I20260808 07:05:53.466058 27417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "23990fe3285a401abea986ee3de75e4d"
format_stamp: "Formatted at 2026-08-08 07:05:53 on dist-test-slave-zj8q"
server_key: "7d97b0d214c202c1ce0157bc4f7a4cc1"
server_key_iv: "fcac5b0f5fa973f7d163263f97064913"
server_key_version: "encryptionkey@0"
I20260808 07:05:53.467343 27417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:05:53.467969 27441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:53.468115 27417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:05:53.468218 27417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "23990fe3285a401abea986ee3de75e4d"
format_stamp: "Formatted at 2026-08-08 07:05:53 on dist-test-slave-zj8q"
server_key: "7d97b0d214c202c1ce0157bc4f7a4cc1"
server_key_iv: "fcac5b0f5fa973f7d163263f97064913"
server_key_version: "encryptionkey@0"
I20260808 07:05:53.468286 27417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:53.480028 27417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:53.482041 27417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:53.482216 27417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:53.485929 27417 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44055
I20260808 07:05:53.485980 27517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44055 every 8 connection(s)
I20260808 07:05:53.486395 27417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:53.487278 27519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:53.489526 27519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d: Bootstrap starting.
I20260808 07:05:53.490113 27519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:53.490432 27519 log.cc:824] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:53.491135 27519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d: No bootstrap required, opened a new log
I20260808 07:05:53.492717 27519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23990fe3285a401abea986ee3de75e4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260808 07:05:53.492851 27519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:53.492883 27519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23990fe3285a401abea986ee3de75e4d, State: Initialized, Role: FOLLOWER
I20260808 07:05:53.493028 27519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23990fe3285a401abea986ee3de75e4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260808 07:05:53.493112 27519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:53.493151 27519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:53.493199 27519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:53.493703 27519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23990fe3285a401abea986ee3de75e4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260808 07:05:53.493794 27519 leader_election.cc:302] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23990fe3285a401abea986ee3de75e4d; no voters:
I20260808 07:05:53.493947 27519 leader_election.cc:288] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:53.493983 27522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:53.494145 27522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [term 1 LEADER]: Becoming Leader. State: Replica: 23990fe3285a401abea986ee3de75e4d, State: Running, Role: LEADER
I20260808 07:05:53.494218 27519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:53.494257 27522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23990fe3285a401abea986ee3de75e4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } }
I20260808 07:05:53.494611 27523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23990fe3285a401abea986ee3de75e4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23990fe3285a401abea986ee3de75e4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } } }
I20260808 07:05:53.494612 27524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23990fe3285a401abea986ee3de75e4d. Latest consensus state: current_term: 1 leader_uuid: "23990fe3285a401abea986ee3de75e4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23990fe3285a401abea986ee3de75e4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44055 } } }
I20260808 07:05:53.494737 27523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:53.494760 27524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:53.495124 27526 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:53.495605 27526 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:53.496573 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27417
I20260808 07:05:53.496701 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:53.496908 26718 external_mini_cluster.cc:1428] Setting key 57bd9af83ee828ebe42b7d96655066eb
I20260808 07:05:53.497108 27526 catalog_manager.cc:1347] Generated new cluster ID: 9f4075a19f0740c098b48270dc4bbeec
I20260808 07:05:53.497156 27526 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:53 dist-test-slave-zj8q krb5kdc[27397](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:05:53.506942 27559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:53.497502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:43307 (local address 127.0.0.1:44055)
0808 07:05:53.497652 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:53.497661 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:53.498338 (+ 677us) server_negotiation.cc:407] Connection header received
0808 07:05:53.498482 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:53.498487 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:53.498541 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:53.498706 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:53.499316 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:53.500247 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:53.501048 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:53.501470 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:53.501566 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:53.503798 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:53.503803 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:53.503803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:53.503815 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:53.505372 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:53.505748 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:53.505751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:53.505752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:53.505849 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:53.506060 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:53.506061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:53.506062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:53.506352 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:53.506532 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:53.506614 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 07:05:53.506712 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260808 07:05:53.507741 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:53.520179 27559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:53.514485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:56029 (local address 127.0.0.1:44055)
0808 07:05:53.514529 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:53.514532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:53.514696 (+ 164us) server_negotiation.cc:407] Connection header received
0808 07:05:53.514750 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:53.514751 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:53.514761 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:53.514806 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:53.515286 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:53.515759 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:53.516461 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:53.516676 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:53.516731 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:53.517801 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:53.517802 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:53.517803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:53.517809 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:53.518995 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:53.519323 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:53.519324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:53.519325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:53.519375 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:53.519561 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:53.519562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:53.519562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:53.519665 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:53.519752 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:53.520051 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 07:05:53.520100 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:05:53.520336 27526 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:53.521078 27526 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:53.529400 27526 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23990fe3285a401abea986ee3de75e4d: Generated new TSK 0
I20260808 07:05:53.529578 27526 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:53.537640 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27417
W20260808 07:05:53.551278 27391 connection.cc:535] client connection to 127.0.0.1:44055 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44055): Connection reset by peer (error 104)
2026-08-08T07:05:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:53 dist-test-slave-zj8q krb5kdc[27577](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:53 dist-test-slave-zj8q krb5kdc[27577](info): set up 2 sockets
Aug 08 07:05:53 dist-test-slave-zj8q krb5kdc[27577](info): commencing operation
krb5kdc: starting...
W20260808 07:05:54.685662 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:54 dist-test-slave-zj8q krb5kdc[27577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:54.801113 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41039
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:54.881073 27601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:54.881271 27601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:54.881302 27601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:54.882445 27601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:54.882488 27601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:54.882507 27601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:54.882522 27601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:54.882539 27601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:54.884020 27601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41039
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:54.884258 27601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:54.884460 27601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:54.889101 27611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:54.889179 27607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:54.889241 27601 server_base.cc:1034] running on GCE node
W20260808 07:05:54.889144 27608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:54.889562 27601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:54.889801 27601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:54.890921 27601 hybrid_clock.cc:648] HybridClock initialized: now 1786172754890901 us; error 35 us; skew 500 ppm
Aug 08 07:05:54 dist-test-slave-zj8q krb5kdc[27577](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172754, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:54.893297 27601 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:54.893679 27601 webserver.cc:460] Webserver started at http://127.0.0.1:34101/ using document root <none> and password file <none>
I20260808 07:05:54.893870 27601 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:54.893908 27601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:54.893999 27601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:54.895248 27601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "e2d507a056344b3c98aff1590c3d6158"
format_stamp: "Formatted at 2026-08-08 07:05:54 on dist-test-slave-zj8q"
server_key: "a8e57dbca62ab45069e64a6f9303c1d1"
server_key_iv: "f79cf30a880301518af51dffc6cbcac6"
server_key_version: "encryptionkey@0"
I20260808 07:05:54.895570 27601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "e2d507a056344b3c98aff1590c3d6158"
format_stamp: "Formatted at 2026-08-08 07:05:54 on dist-test-slave-zj8q"
server_key: "a8e57dbca62ab45069e64a6f9303c1d1"
server_key_iv: "f79cf30a880301518af51dffc6cbcac6"
server_key_version: "encryptionkey@0"
I20260808 07:05:54.896713 27601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:54.897311 27618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:54.897464 27601 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:54.897549 27601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "e2d507a056344b3c98aff1590c3d6158"
format_stamp: "Formatted at 2026-08-08 07:05:54 on dist-test-slave-zj8q"
server_key: "a8e57dbca62ab45069e64a6f9303c1d1"
server_key_iv: "f79cf30a880301518af51dffc6cbcac6"
server_key_version: "encryptionkey@0"
I20260808 07:05:54.897617 27601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:54.927716 27601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:54.929791 27601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:54.929927 27601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:54.933627 27601 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41039
I20260808 07:05:54.933696 27698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41039 every 8 connection(s)
I20260808 07:05:54.933991 27601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:54.934801 27700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:54.935802 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27601
I20260808 07:05:54.935911 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:54.936120 26718 external_mini_cluster.cc:1428] Setting key 82cf57968c009e7a43cc6045b929ebfb
I20260808 07:05:54.937506 27700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158: Bootstrap starting.
I20260808 07:05:54.938099 27700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:54.938418 27700 log.cc:824] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:54.939134 27700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158: No bootstrap required, opened a new log
I20260808 07:05:54.941293 27700 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d507a056344b3c98aff1590c3d6158" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41039 } }
I20260808 07:05:54.941463 27700 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:54.941532 27700 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2d507a056344b3c98aff1590c3d6158, State: Initialized, Role: FOLLOWER
I20260808 07:05:54.941668 27700 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d507a056344b3c98aff1590c3d6158" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41039 } }
I20260808 07:05:54.941728 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:54.936628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:34005 (local address 127.0.0.1:41039)
0808 07:05:54.936781 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:54.936789 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:54.936813 (+ 24us) server_negotiation.cc:407] Connection header received
0808 07:05:54.937281 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:54.937288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:54.937336 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:54.937446 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:54.937727 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:54.938769 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:54.939817 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:54.940225 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:54.940301 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:54.940972 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:54.940976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:54.940976 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:54.941137 (+ 161us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:54.941166 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:54.941177 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:54.941237 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:54.941358 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 07:05:54.941387 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260808 07:05:54.941744 27700 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:54.941810 27700 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:54.941854 27700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:54.942452 27700 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d507a056344b3c98aff1590c3d6158" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41039 } }
I20260808 07:05:54.942552 27700 leader_election.cc:302] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2d507a056344b3c98aff1590c3d6158; no voters:
I20260808 07:05:54.942657 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:54.942704 27700 leader_election.cc:288] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:54.942756 27708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:54.942899 27708 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [term 1 LEADER]: Becoming Leader. State: Replica: e2d507a056344b3c98aff1590c3d6158, State: Running, Role: LEADER
I20260808 07:05:54.942942 27700 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:54.943005 27708 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d507a056344b3c98aff1590c3d6158" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41039 } }
I20260808 07:05:54.943359 27708 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2d507a056344b3c98aff1590c3d6158. Latest consensus state: current_term: 1 leader_uuid: "e2d507a056344b3c98aff1590c3d6158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d507a056344b3c98aff1590c3d6158" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41039 } } }
I20260808 07:05:54.943454 27708 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:54.943425 27710 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2d507a056344b3c98aff1590c3d6158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2d507a056344b3c98aff1590c3d6158" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41039 } } }
I20260808 07:05:54.943516 27710 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:54.944556 27718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:54.945653 27718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:54.946869 27703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:54.944271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:37451 (local address 127.0.0.1:41039)
0808 07:05:54.944300 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:54.944302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:54.944310 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:05:54.944347 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:54.944348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:54.944358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:54.944408 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:54.944528 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:54.945018 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:54.945754 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:54.945961 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:54.946012 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:54.946628 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:54.946629 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:54.946630 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:54.946634 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:54.946649 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:54.946653 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:54.946712 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:54.946796 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 07:05:54.946806 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 07:05:54.947537 27718 catalog_manager.cc:1347] Generated new cluster ID: 767fbb89bf7e4385a6dfdc5a97ababb3
I20260808 07:05:54.947590 27718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:54.967249 27718 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:54.967746 27718 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:54.972054 27718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2d507a056344b3c98aff1590c3d6158: Generated new TSK 0
I20260808 07:05:54.972213 27718 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:54.979039 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27601
W20260808 07:05:54.992985 27570 connection.cc:535] client connection to 127.0.0.1:41039 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41039): Connection reset by peer (error 104)
2026-08-08T07:05:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:55 dist-test-slave-zj8q krb5kdc[27749](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:55 dist-test-slave-zj8q krb5kdc[27749](info): set up 2 sockets
Aug 08 07:05:55 dist-test-slave-zj8q krb5kdc[27749](info): commencing operation
krb5kdc: starting...
W20260808 07:05:56.135511 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:56 dist-test-slave-zj8q krb5kdc[27749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:56.248482 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38343
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38343
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:56.329034 27773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:56.329219 27773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:56.329241 27773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:56.330319 27773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:56.330353 27773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:56.330366 27773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:56.330377 27773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:56.330387 27773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:56.331795 27773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:56.331980 27773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:56.332190 27773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:56.336876 27783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:56.336867 27782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:56.336978 27773 server_base.cc:1034] running on GCE node
W20260808 07:05:56.336869 27785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:56.337339 27773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:56.337585 27773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:56.338718 27773 hybrid_clock.cc:648] HybridClock initialized: now 1786172756338703 us; error 28 us; skew 500 ppm
Aug 08 07:05:56 dist-test-slave-zj8q krb5kdc[27749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172756, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:56.341125 27773 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:56.341528 27773 webserver.cc:460] Webserver started at http://127.0.0.1:37595/ using document root <none> and password file <none>
I20260808 07:05:56.341735 27773 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:56.341779 27773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:56.341893 27773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:56.342945 27773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "0898d1e9d39a484897e69a27cce34c86"
format_stamp: "Formatted at 2026-08-08 07:05:56 on dist-test-slave-zj8q"
server_key: "81971e358ea33ba08a00ffd49ff7d1a8"
server_key_iv: "97a526871ded41eeeedfd11cb9597303"
server_key_version: "encryptionkey@0"
I20260808 07:05:56.343264 27773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "0898d1e9d39a484897e69a27cce34c86"
format_stamp: "Formatted at 2026-08-08 07:05:56 on dist-test-slave-zj8q"
server_key: "81971e358ea33ba08a00ffd49ff7d1a8"
server_key_iv: "97a526871ded41eeeedfd11cb9597303"
server_key_version: "encryptionkey@0"
I20260808 07:05:56.344462 27773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:05:56.345125 27797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:56.345293 27773 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:56.345378 27773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "0898d1e9d39a484897e69a27cce34c86"
format_stamp: "Formatted at 2026-08-08 07:05:56 on dist-test-slave-zj8q"
server_key: "81971e358ea33ba08a00ffd49ff7d1a8"
server_key_iv: "97a526871ded41eeeedfd11cb9597303"
server_key_version: "encryptionkey@0"
I20260808 07:05:56.345438 27773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:56.348635 27773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:56.350409 27773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:56.350534 27773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:56.354513 27773 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38343
I20260808 07:05:56.354548 27887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38343 every 8 connection(s)
I20260808 07:05:56.354840 27773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:56.355757 27888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:56.357833 27888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86: Bootstrap starting.
I20260808 07:05:56.358387 27888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:56.358614 27888 log.cc:824] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:56.359247 27888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86: No bootstrap required, opened a new log
I20260808 07:05:56.360777 27888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0898d1e9d39a484897e69a27cce34c86" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38343 } }
I20260808 07:05:56.360905 27888 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:56.360926 27888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0898d1e9d39a484897e69a27cce34c86, State: Initialized, Role: FOLLOWER
I20260808 07:05:56.361020 27888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0898d1e9d39a484897e69a27cce34c86" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38343 } }
I20260808 07:05:56.361078 27888 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:56.361100 27888 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:56.361129 27888 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:56.361567 27888 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0898d1e9d39a484897e69a27cce34c86" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38343 } }
I20260808 07:05:56.361647 27888 leader_election.cc:302] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0898d1e9d39a484897e69a27cce34c86; no voters:
I20260808 07:05:56.361759 27888 leader_election.cc:288] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:56.361809 27897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:56.361965 27888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:56.361986 27897 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [term 1 LEADER]: Becoming Leader. State: Replica: 0898d1e9d39a484897e69a27cce34c86, State: Running, Role: LEADER
I20260808 07:05:56.362124 27897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0898d1e9d39a484897e69a27cce34c86" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38343 } }
I20260808 07:05:56.362581 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27773
I20260808 07:05:56.362689 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:56.362897 26718 external_mini_cluster.cc:1428] Setting key abbd341fa489118aa02ad5feb5ddfb82
I20260808 07:05:56.363312 27899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0898d1e9d39a484897e69a27cce34c86. Latest consensus state: current_term: 1 leader_uuid: "0898d1e9d39a484897e69a27cce34c86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0898d1e9d39a484897e69a27cce34c86" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38343 } } }
I20260808 07:05:56.363426 27899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:56.363516 27898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0898d1e9d39a484897e69a27cce34c86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0898d1e9d39a484897e69a27cce34c86" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38343 } } }
I20260808 07:05:56.363611 27898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:56.363740 27923 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:56.364336 27923 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:56.365137 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:56.363318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:49425 (local address 127.0.0.1:38343)
0808 07:05:56.363567 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:56.363576 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:56.363832 (+ 256us) server_negotiation.cc:407] Connection header received
0808 07:05:56.363990 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:56.363998 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:56.364024 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:56.364143 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:56.364734 (+ 591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:56.364737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:56.364738 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:56.364741 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:56.364785 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:56.364795 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:56.364847 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:56.364919 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 07:05:56.364960 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":85,"threads_started":1}
I20260808 07:05:56.365814 27923 catalog_manager.cc:1347] Generated new cluster ID: 472d95934c6b4ac39606217205bd14d1
I20260808 07:05:56.365865 27923 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:56.366010 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:56.371248 27917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:56.367470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:32893 (local address 127.0.0.1:38343)
0808 07:05:56.367502 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:56.367503 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:56.370401 (+ 2898us) server_negotiation.cc:407] Connection header received
0808 07:05:56.370449 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:56.370449 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:56.370455 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:56.370521 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:56.371035 (+ 514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:56.371036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:56.371036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:56.371041 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:56.371057 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:56.371061 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:56.371115 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:56.371165 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:05:56.371177 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:05:56.378432 27923 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:56.378577 27923 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:56.381450 27923 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0898d1e9d39a484897e69a27cce34c86: Generated new TSK 0
I20260808 07:05:56.381603 27923 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:56.384898 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27773
2026-08-08T07:05:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1403 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:56 dist-test-slave-zj8q krb5kdc[27941](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:56 dist-test-slave-zj8q krb5kdc[27941](info): set up 2 sockets
Aug 08 07:05:56 dist-test-slave-zj8q krb5kdc[27941](info): commencing operation
krb5kdc: starting...
W20260808 07:05:57.534355 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:57 dist-test-slave-zj8q krb5kdc[27941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:57.650985 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41993
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:57.730931 27965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:57.731139 27965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:57.731172 27965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:57.732282 27965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:57.732326 27965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:57.732344 27965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:57.732360 27965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:57.732378 27965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:57.733852 27965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41993
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:57.734092 27965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:57.734319 27965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:57.738987 27974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:57.739050 27976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:57.738993 27971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:57.739207 27965 server_base.cc:1034] running on GCE node
I20260808 07:05:57.739444 27965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:57.739733 27965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:57.740880 27965 hybrid_clock.cc:648] HybridClock initialized: now 1786172757740857 us; error 39 us; skew 500 ppm
Aug 08 07:05:57 dist-test-slave-zj8q krb5kdc[27941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172757, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:57.743502 27965 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:57.743942 27965 webserver.cc:460] Webserver started at http://127.0.0.1:37121/ using document root <none> and password file <none>
I20260808 07:05:57.744136 27965 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:57.744179 27965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:57.744273 27965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:57.745343 27965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "83415edfa94541b8915f954c075afdbb"
format_stamp: "Formatted at 2026-08-08 07:05:57 on dist-test-slave-zj8q"
server_key: "ae9c66fabab72bd17af5c6d85b877fc0"
server_key_iv: "95b41c4994f78b4803e4c7af5becb665"
server_key_version: "encryptionkey@0"
I20260808 07:05:57.745672 27965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "83415edfa94541b8915f954c075afdbb"
format_stamp: "Formatted at 2026-08-08 07:05:57 on dist-test-slave-zj8q"
server_key: "ae9c66fabab72bd17af5c6d85b877fc0"
server_key_iv: "95b41c4994f78b4803e4c7af5becb665"
server_key_version: "encryptionkey@0"
I20260808 07:05:57.746896 27965 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:05:57.747574 27993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:57.747763 27965 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:57.747864 27965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "83415edfa94541b8915f954c075afdbb"
format_stamp: "Formatted at 2026-08-08 07:05:57 on dist-test-slave-zj8q"
server_key: "ae9c66fabab72bd17af5c6d85b877fc0"
server_key_iv: "95b41c4994f78b4803e4c7af5becb665"
server_key_version: "encryptionkey@0"
I20260808 07:05:57.747937 27965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:57.770695 27965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:57.772451 27965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:57.772594 27965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:57.776667 27965 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41993
I20260808 07:05:57.776717 28083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41993 every 8 connection(s)
I20260808 07:05:57.777040 27965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:57.777856 28084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:57.780150 28084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb: Bootstrap starting.
I20260808 07:05:57.780720 28084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:57.780977 28084 log.cc:824] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:57.781716 28084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb: No bootstrap required, opened a new log
I20260808 07:05:57.783316 28084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83415edfa94541b8915f954c075afdbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41993 } }
I20260808 07:05:57.783455 28084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:57.783478 28084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83415edfa94541b8915f954c075afdbb, State: Initialized, Role: FOLLOWER
I20260808 07:05:57.783620 28084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83415edfa94541b8915f954c075afdbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41993 } }
I20260808 07:05:57.783689 28084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:57.783712 28084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:57.783759 28084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:57.784264 28084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83415edfa94541b8915f954c075afdbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41993 } }
I20260808 07:05:57.784355 28084 leader_election.cc:302] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83415edfa94541b8915f954c075afdbb; no voters:
I20260808 07:05:57.784516 28084 leader_election.cc:288] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:57.784551 28087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:57.784721 28087 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [term 1 LEADER]: Becoming Leader. State: Replica: 83415edfa94541b8915f954c075afdbb, State: Running, Role: LEADER
I20260808 07:05:57.784739 28084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:57.784837 28087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83415edfa94541b8915f954c075afdbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41993 } }
I20260808 07:05:57.785212 28092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83415edfa94541b8915f954c075afdbb. Latest consensus state: current_term: 1 leader_uuid: "83415edfa94541b8915f954c075afdbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83415edfa94541b8915f954c075afdbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41993 } } }
I20260808 07:05:57.785343 28092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:57.785509 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 27965
I20260808 07:05:57.785660 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:57.785838 26718 external_mini_cluster.cc:1428] Setting key 84b64cd0909d01fb50dfecf271ad55ea
I20260808 07:05:57.785833 28105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:57.785941 28090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83415edfa94541b8915f954c075afdbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83415edfa94541b8915f954c075afdbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41993 } } }
I20260808 07:05:57.786042 28090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:57.786405 28105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:57.790618 28105 catalog_manager.cc:1347] Generated new cluster ID: f62f45cc5a2f4b6c921e94414fad383a
I20260808 07:05:57.790685 28105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:05:57 dist-test-slave-zj8q krb5kdc[27941](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 07:05:57.796146 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:57.786345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:46981 (local address 127.0.0.1:41993)
0808 07:05:57.786676 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:57.786687 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:57.786861 (+ 174us) server_negotiation.cc:407] Connection header received
0808 07:05:57.786985 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:57.786993 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:57.787052 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:57.787178 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:57.788107 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:57.789495 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:57.790265 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:57.790776 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:57.790885 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:57.793143 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:57.793147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:57.793148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:57.793158 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:57.794701 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:57.795066 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:57.795069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:57.795069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:57.795164 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:57.795368 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:57.795369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:57.795369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:57.795601 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:57.795768 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:57.795852 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 07:05:57.795950 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":78,"threads_started":1}
I20260808 07:05:57.797245 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:57.807884 28105 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:57.808099 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:57.798524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:56483 (local address 127.0.0.1:41993)
0808 07:05:57.798558 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:57.798559 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:57.802345 (+ 3786us) server_negotiation.cc:407] Connection header received
0808 07:05:57.802407 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:57.802408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:57.802418 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:57.802470 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:57.802999 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:57.803508 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:57.804195 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:57.804428 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:57.804482 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:57.805588 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:57.805589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:57.805590 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:05:57.805597 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:57.806875 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:57.807217 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:57.807219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:57.807219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:57.807283 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:05:57.807557 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:05:57.807558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:05:57.807558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:05:57.807683 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:57.807777 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:57.807958 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 07:05:57.808016 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:05:57.808732 28105 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:57.814297 28105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83415edfa94541b8915f954c075afdbb: Generated new TSK 0
I20260808 07:05:57.814465 28105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:57.817924 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 27965
W20260808 07:05:57.831349 27935 connection.cc:535] client connection to 127.0.0.1:41993 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41993): Connection reset by peer (error 104)
2026-08-08T07:05:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:57 dist-test-slave-zj8q krb5kdc[28138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:57 dist-test-slave-zj8q krb5kdc[28138](info): set up 2 sockets
Aug 08 07:05:57 dist-test-slave-zj8q krb5kdc[28138](info): commencing operation
krb5kdc: starting...
W20260808 07:05:58.963337 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:05:59 dist-test-slave-zj8q krb5kdc[28138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:05:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:05:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:05:59.076925 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45959
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:05:59.159137 28163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:05:59.159340 28163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:05:59.159370 28163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:05:59.160495 28163 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:05:59.160622 28163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:05:59.160646 28163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:05:59.160662 28163 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:05:59.160678 28163 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:05:59.162220 28163 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45959
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28163
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:05:59.162459 28163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:05:59.162672 28163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:05:59.167469 28174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:59.167479 28180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:05:59.167503 28175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:05:59.167718 28163 server_base.cc:1034] running on GCE node
I20260808 07:05:59.167945 28163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:05:59.168187 28163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:05:59.169327 28163 hybrid_clock.cc:648] HybridClock initialized: now 1786172759169321 us; error 35 us; skew 500 ppm
Aug 08 07:05:59 dist-test-slave-zj8q krb5kdc[28138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172759, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:05:59.171651 28163 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:05:59.172058 28163 webserver.cc:460] Webserver started at http://127.0.0.1:33109/ using document root <none> and password file <none>
I20260808 07:05:59.172253 28163 fs_manager.cc:359] Metadata directory not provided
I20260808 07:05:59.172302 28163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:05:59.172426 28163 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:05:59.173460 28163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "77ae89639404454180e5d0e84f9f6c72"
format_stamp: "Formatted at 2026-08-08 07:05:59 on dist-test-slave-zj8q"
server_key: "91c27d18fcb8560f5b5efb1cab8acab6"
server_key_iv: "30cd9ec3cac56494e5c8445d76dcc396"
server_key_version: "encryptionkey@0"
I20260808 07:05:59.173787 28163 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "77ae89639404454180e5d0e84f9f6c72"
format_stamp: "Formatted at 2026-08-08 07:05:59 on dist-test-slave-zj8q"
server_key: "91c27d18fcb8560f5b5efb1cab8acab6"
server_key_iv: "30cd9ec3cac56494e5c8445d76dcc396"
server_key_version: "encryptionkey@0"
I20260808 07:05:59.175060 28163 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:05:59.175700 28191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:05:59.175853 28163 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:05:59.175936 28163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "77ae89639404454180e5d0e84f9f6c72"
format_stamp: "Formatted at 2026-08-08 07:05:59 on dist-test-slave-zj8q"
server_key: "91c27d18fcb8560f5b5efb1cab8acab6"
server_key_iv: "30cd9ec3cac56494e5c8445d76dcc396"
server_key_version: "encryptionkey@0"
I20260808 07:05:59.175997 28163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:05:59.187762 28163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:05:59.189469 28163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:05:59.189595 28163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:05:59.193471 28163 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45959
I20260808 07:05:59.193504 28270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45959 every 8 connection(s)
I20260808 07:05:59.193814 28163 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:05:59.194661 28271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:05:59.196830 28271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72: Bootstrap starting.
I20260808 07:05:59.197373 28271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72: Neither blocks nor log segments found. Creating new log.
I20260808 07:05:59.197639 28271 log.cc:824] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72: Log is configured to *not* fsync() on all Append() calls
I20260808 07:05:59.198364 28271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72: No bootstrap required, opened a new log
I20260808 07:05:59.199970 28271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ae89639404454180e5d0e84f9f6c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45959 } }
I20260808 07:05:59.200112 28271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:05:59.200135 28271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77ae89639404454180e5d0e84f9f6c72, State: Initialized, Role: FOLLOWER
I20260808 07:05:59.200265 28271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ae89639404454180e5d0e84f9f6c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45959 } }
I20260808 07:05:59.200325 28271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:05:59.200356 28271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:05:59.200403 28271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:05:59.200898 28271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ae89639404454180e5d0e84f9f6c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45959 } }
I20260808 07:05:59.200989 28271 leader_election.cc:302] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77ae89639404454180e5d0e84f9f6c72; no voters:
I20260808 07:05:59.201141 28271 leader_election.cc:288] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:05:59.201180 28277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:05:59.201328 28277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [term 1 LEADER]: Becoming Leader. State: Replica: 77ae89639404454180e5d0e84f9f6c72, State: Running, Role: LEADER
I20260808 07:05:59.201390 28271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:05:59.201387 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28163
I20260808 07:05:59.201443 28277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ae89639404454180e5d0e84f9f6c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45959 } }
I20260808 07:05:59.201489 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:05:59.201683 26718 external_mini_cluster.cc:1428] Setting key bbe85732d6927c257174d13681a0e09c
I20260808 07:05:59.201799 28277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77ae89639404454180e5d0e84f9f6c72. Latest consensus state: current_term: 1 leader_uuid: "77ae89639404454180e5d0e84f9f6c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ae89639404454180e5d0e84f9f6c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45959 } } }
I20260808 07:05:59.201866 28277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [sys.catalog]: This master's current role is: LEADER
I20260808 07:05:59.201994 28282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77ae89639404454180e5d0e84f9f6c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77ae89639404454180e5d0e84f9f6c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45959 } } }
I20260808 07:05:59.202075 28282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72 [sys.catalog]: This master's current role is: LEADER
W20260808 07:05:59.203197 28306 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:05:59.203258 28306 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:05:59.203302 28293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:05:59.203462 28293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:05:59.204797 28293 catalog_manager.cc:1347] Generated new cluster ID: 0b172cf28562465791dc0deab981b9c3
I20260808 07:05:59.204847 28293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:05:59.207489 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:59.202298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:48601 (local address 127.0.0.1:45959)
0808 07:05:59.202463 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:59.202472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:59.202504 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:05:59.202625 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:59.202632 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:59.202688 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:59.202820 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:59.203148 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:59.204329 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:59.205428 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:59.206044 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:59.206141 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:59.206837 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:59.206840 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:59.206841 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:59.207037 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:59.207074 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:59.207088 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:59.207162 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:59.207260 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 07:05:59.207285 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260808 07:05:59.208420 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:05:59.213512 28297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:05:59.209879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:59639 (local address 127.0.0.1:45959)
0808 07:05:59.209913 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:05:59.209914 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:05:59.210337 (+ 423us) server_negotiation.cc:407] Connection header received
0808 07:05:59.210405 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:05:59.210405 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:05:59.210415 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:05:59.210460 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:05:59.210588 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:59.211296 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:59.212266 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:05:59.212596 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:05:59.212649 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:05:59.213277 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:05:59.213278 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:05:59.213278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:05:59.213282 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:05:59.213296 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:05:59.213300 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:05:59.213348 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:05:59.213427 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 07:05:59.213439 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:05:59.228869 28293 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:05:59.229378 28293 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:05:59.243693 28293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77ae89639404454180e5d0e84f9f6c72: Generated new TSK 0
I20260808 07:05:59.243867 28293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:05:59.247818 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28163
W20260808 07:05:59.261646 28136 connection.cc:535] client connection to 127.0.0.1:45959 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45959): Connection reset by peer (error 104)
2026-08-08T07:05:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1430 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:05:59 dist-test-slave-zj8q krb5kdc[28325](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:05:59 dist-test-slave-zj8q krb5kdc[28325](info): set up 2 sockets
Aug 08 07:05:59 dist-test-slave-zj8q krb5kdc[28325](info): commencing operation
krb5kdc: starting...
W20260808 07:06:00.390467 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:00 dist-test-slave-zj8q krb5kdc[28325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 07:06:00.507138 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46819
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:00.587579 28345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:00.587790 28345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:00.587813 28345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:00.588953 28345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:00.588994 28345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:00.589007 28345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:00.589018 28345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:00.589030 28345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:00.590557 28345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46819
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:00.590785 28345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:00.590992 28345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:00.595696 28353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:00.595736 28351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:00.595711 28355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:00.595995 28345 server_base.cc:1034] running on GCE node
I20260808 07:06:00.596236 28345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:00.596506 28345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:00.597638 28345 hybrid_clock.cc:648] HybridClock initialized: now 1786172760597623 us; error 30 us; skew 500 ppm
Aug 08 07:06:00 dist-test-slave-zj8q krb5kdc[28325](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172760, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:00.600057 28345 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 07:06:00.600513 28345 webserver.cc:460] Webserver started at http://127.0.0.1:36645/ using document root <none> and password file <none>
I20260808 07:06:00.600710 28345 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:00.600761 28345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:00.600889 28345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:00.601956 28345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "6f1a0848aad04ae7a5d4a8e82fba1245"
format_stamp: "Formatted at 2026-08-08 07:06:00 on dist-test-slave-zj8q"
server_key: "c0ee733fc130e1c0d39c79358cd952cf"
server_key_iv: "6373ea561d4ece54d59d3430b105581c"
server_key_version: "encryptionkey@0"
I20260808 07:06:00.602337 28345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "6f1a0848aad04ae7a5d4a8e82fba1245"
format_stamp: "Formatted at 2026-08-08 07:06:00 on dist-test-slave-zj8q"
server_key: "c0ee733fc130e1c0d39c79358cd952cf"
server_key_iv: "6373ea561d4ece54d59d3430b105581c"
server_key_version: "encryptionkey@0"
I20260808 07:06:00.603579 28345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 07:06:00.604262 28370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:00.604423 28345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:00.604511 28345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "6f1a0848aad04ae7a5d4a8e82fba1245"
format_stamp: "Formatted at 2026-08-08 07:06:00 on dist-test-slave-zj8q"
server_key: "c0ee733fc130e1c0d39c79358cd952cf"
server_key_iv: "6373ea561d4ece54d59d3430b105581c"
server_key_version: "encryptionkey@0"
I20260808 07:06:00.604569 28345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:00.607836 28345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:00.609634 28345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:00.609763 28345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:00.613647 28345 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46819
I20260808 07:06:00.613686 28461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46819 every 8 connection(s)
I20260808 07:06:00.613981 28345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:00.614933 28462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:00.617177 28462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245: Bootstrap starting.
I20260808 07:06:00.617769 28462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:00.618029 28462 log.cc:824] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:00.618721 28462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245: No bootstrap required, opened a new log
I20260808 07:06:00.620360 28462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46819 } }
I20260808 07:06:00.620498 28462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:00.620520 28462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1a0848aad04ae7a5d4a8e82fba1245, State: Initialized, Role: FOLLOWER
I20260808 07:06:00.620664 28462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46819 } }
I20260808 07:06:00.620725 28462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:00.620748 28462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:00.620793 28462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:00.621309 28462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46819 } }
I20260808 07:06:00.621405 28462 leader_election.cc:302] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f1a0848aad04ae7a5d4a8e82fba1245; no voters:
I20260808 07:06:00.621562 28462 leader_election.cc:288] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:00.621589 28470 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:00.621675 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28345
I20260808 07:06:00.621704 28470 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [term 1 LEADER]: Becoming Leader. State: Replica: 6f1a0848aad04ae7a5d4a8e82fba1245, State: Running, Role: LEADER
I20260808 07:06:00.621795 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:00.621781 28470 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46819 } }
I20260808 07:06:00.621836 28462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:00.621976 26718 external_mini_cluster.cc:1428] Setting key eac45915eb1acbeaf9b6531fa6f378e5
I20260808 07:06:00.622203 28471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46819 } } }
I20260808 07:06:00.622291 28471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:00.622313 28472 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f1a0848aad04ae7a5d4a8e82fba1245. Latest consensus state: current_term: 1 leader_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f1a0848aad04ae7a5d4a8e82fba1245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46819 } } }
I20260808 07:06:00.622385 28472 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:00.622958 28477 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:00.623523 28477 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:00.625188 28477 catalog_manager.cc:1347] Generated new cluster ID: 66e509630c294680a41aef4df1b86dce
I20260808 07:06:00.625267 28477 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:00.625350 28486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.622721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:34353 (local address 127.0.0.1:46819)
0808 07:06:00.623475 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:00.623485 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:00.623519 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:06:00.623650 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:00.623658 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:00.623691 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:00.623843 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:00.624868 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:00.624872 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:00.624873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:00.624877 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:00.624921 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:00.624933 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:00.624988 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:00.625064 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 07:06:00.625112 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":62,"threads_started":1}
I20260808 07:06:00.626204 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:00.635154 28486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:00.630488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.236:41269 (local address 127.0.0.1:46819)
0808 07:06:00.630523 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:00.630525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:00.634308 (+ 3783us) server_negotiation.cc:407] Connection header received
0808 07:06:00.634376 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:00.634376 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:00.634383 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:00.634429 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:00.634945 (+ 516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:00.634946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:00.634946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:00.634950 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:00.634966 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:00.634970 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:00.635018 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:00.635075 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 07:06:00.635088 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:06:00.636013 28477 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:00.636173 28477 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:00.648097 28477 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f1a0848aad04ae7a5d4a8e82fba1245: Generated new TSK 0
I20260808 07:06:00.648269 28477 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:00.653015 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28345
2026-08-08T07:06:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:00 dist-test-slave-zj8q krb5kdc[28515](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:00 dist-test-slave-zj8q krb5kdc[28515](info): set up 2 sockets
Aug 08 07:06:00 dist-test-slave-zj8q krb5kdc[28515](info): commencing operation
krb5kdc: starting...
W20260808 07:06:01.792124 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:01 dist-test-slave-zj8q krb5kdc[28515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:01.913120 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:44205
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:37549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:44205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:01.993126 28534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:01.993335 28534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:01.993364 28534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:01.994513 28534 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:01.994553 28534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:01.994571 28534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:01.994588 28534 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:01.994603 28534 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:01.996019 28534 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:37549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:44205
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:44205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:01.996253 28534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:01.996449 28534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:02.001147 28545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:02.001159 28546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:02.001139 28550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:02.001356 28534 server_base.cc:1034] running on GCE node
I20260808 07:06:02.001636 28534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:02.001901 28534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:02.003037 28534 hybrid_clock.cc:648] HybridClock initialized: now 1786172762003017 us; error 36 us; skew 500 ppm
Aug 08 07:06:02 dist-test-slave-zj8q krb5kdc[28515](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172762, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:02.010764 28534 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:02.011235 28534 webserver.cc:460] Webserver started at http://127.26.23.190:42905/ using document root <none> and password file <none>
I20260808 07:06:02.011437 28534 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:02.011484 28534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:02.011610 28534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:02.012840 28534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "5e321180ff494a34893d5113d64d5d17"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-zj8q"
server_key: "77e9a6620d2780d2dfe081e9bfdf41dd"
server_key_iv: "f4fbe8e8ce38ef1e922c3bf28f2d28da"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.013265 28534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "5e321180ff494a34893d5113d64d5d17"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-zj8q"
server_key: "77e9a6620d2780d2dfe081e9bfdf41dd"
server_key_iv: "f4fbe8e8ce38ef1e922c3bf28f2d28da"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.015004 28534 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 07:06:02.015882 28558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:02.016067 28534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:02.016180 28534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "5e321180ff494a34893d5113d64d5d17"
format_stamp: "Formatted at 2026-08-08 07:06:02 on dist-test-slave-zj8q"
server_key: "77e9a6620d2780d2dfe081e9bfdf41dd"
server_key_iv: "f4fbe8e8ce38ef1e922c3bf28f2d28da"
server_key_version: "encryptionkey@0"
I20260808 07:06:02.016258 28534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:02.047217 28534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:02.049065 28534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:02.049182 28534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:02.053231 28534 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:44205
I20260808 07:06:02.053284 28650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:44205 every 8 connection(s)
I20260808 07:06:02.053601 28534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:02.054541 28651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:02.056903 28651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17: Bootstrap starting.
I20260808 07:06:02.057475 28651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:02.057753 28651 log.cc:824] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:02.058140 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28534
I20260808 07:06:02.058282 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:02.058473 26718 external_mini_cluster.cc:1428] Setting key 5dc38c48270daaf8f5caabc395f56bf7
I20260808 07:06:02.058565 28651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17: No bootstrap required, opened a new log
I20260808 07:06:02.060863 28651 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e321180ff494a34893d5113d64d5d17" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44205 } }
I20260808 07:06:02.061017 28651 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:02.061039 28651 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e321180ff494a34893d5113d64d5d17, State: Initialized, Role: FOLLOWER
I20260808 07:06:02.061154 28651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e321180ff494a34893d5113d64d5d17" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44205 } }
I20260808 07:06:02.061225 28651 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:02.061250 28651 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:02.061297 28651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:02.061892 28651 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e321180ff494a34893d5113d64d5d17" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44205 } }
I20260808 07:06:02.061983 28651 leader_election.cc:302] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e321180ff494a34893d5113d64d5d17; no voters:
I20260808 07:06:02.062141 28651 leader_election.cc:288] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:02.062220 28661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:02.062371 28661 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [term 1 LEADER]: Becoming Leader. State: Replica: 5e321180ff494a34893d5113d64d5d17, State: Running, Role: LEADER
I20260808 07:06:02.062417 28651 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:02.062456 28661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e321180ff494a34893d5113d64d5d17" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44205 } }
I20260808 07:06:02.062778 28663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e321180ff494a34893d5113d64d5d17. Latest consensus state: current_term: 1 leader_uuid: "5e321180ff494a34893d5113d64d5d17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e321180ff494a34893d5113d64d5d17" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44205 } } }
I20260808 07:06:02.062783 28662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e321180ff494a34893d5113d64d5d17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e321180ff494a34893d5113d64d5d17" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44205 } } }
I20260808 07:06:02.062875 28663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:02.062881 28662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:02.063442 28665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:02.064348 28665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:02.065908 28665 catalog_manager.cc:1347] Generated new cluster ID: f1a1f8c8ffd34ca69501c1c91c8915ea
I20260808 07:06:02.065961 28665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:06:02 dist-test-slave-zj8q krb5kdc[28515](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:02.069464 28660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.059010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44753 (local address 127.26.23.190:44205)
0808 07:06:02.059161 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.059170 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.059204 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:06:02.059826 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.059833 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.059881 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.059989 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.060795 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.062066 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.063099 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.063641 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.063740 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.066478 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.066482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.066483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.066495 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.068011 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.068369 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.068372 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.068372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.068458 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.068655 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.068656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.068657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.068880 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.069035 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.069163 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.069269 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":61,"threads_started":1}
I20260808 07:06:02.070587 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:02.077368 28660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:02.072057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42013 (local address 127.26.23.190:44205)
0808 07:06:02.072094 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:02.072095 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:02.072164 (+ 69us) server_negotiation.cc:407] Connection header received
0808 07:06:02.072220 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:02.072221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:02.072231 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:02.072273 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:02.072735 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.073189 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.073851 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:02.074078 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:02.074130 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:02.075147 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:02.075149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:02.075149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:02.075156 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:02.076311 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.076646 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.076647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.076647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.076708 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:02.076895 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:02.076895 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:02.076896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:02.077001 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:02.077086 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:02.077229 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 07:06:02.077286 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:06:02.082204 28665 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:02.082902 28665 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:02.087247 28665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e321180ff494a34893d5113d64d5d17: Generated new TSK 0
I20260808 07:06:02.087405 28665 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:02.091297 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28534
W20260808 07:06:02.121464 28512 connection.cc:535] client connection to 127.26.23.190:44205 recv error: Network error: failed to read from TLS socket (remote: 127.26.23.190:44205): Connection reset by peer (error 104)
2026-08-08T07:06:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:02 dist-test-slave-zj8q krb5kdc[28706](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:02 dist-test-slave-zj8q krb5kdc[28706](info): set up 2 sockets
Aug 08 07:06:02 dist-test-slave-zj8q krb5kdc[28706](info): commencing operation
krb5kdc: starting...
W20260808 07:06:03.262135 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:03 dist-test-slave-zj8q krb5kdc[28706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:03.379092 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33275
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:40697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:33275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:03.459180 28723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:03.459385 28723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:03.459416 28723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:03.460525 28723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:03.460572 28723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:03.460592 28723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:03.460608 28723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:03.460623 28723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:03.462088 28723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:40697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:33275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:33275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:03.462350 28723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:03.462558 28723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:03.467195 28729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:03.467308 28723 server_base.cc:1034] running on GCE node
W20260808 07:06:03.467216 28734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:03.467216 28731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:03.467687 28723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:03.467934 28723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:03.469099 28723 hybrid_clock.cc:648] HybridClock initialized: now 1786172763469076 us; error 36 us; skew 500 ppm
Aug 08 07:06:03 dist-test-slave-zj8q krb5kdc[28706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172763, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:03.471629 28723 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:03.472033 28723 webserver.cc:460] Webserver started at http://127.26.23.190:41433/ using document root <none> and password file <none>
I20260808 07:06:03.472213 28723 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:03.472250 28723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:03.472340 28723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:03.473326 28723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "b1942954c5b44eec8cde19f213a7ed85"
format_stamp: "Formatted at 2026-08-08 07:06:03 on dist-test-slave-zj8q"
server_key: "3e36a96c40973eab56d4faf2312631ed"
server_key_iv: "9aa0d490b7b8e155d254452663134823"
server_key_version: "encryptionkey@0"
I20260808 07:06:03.473623 28723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "b1942954c5b44eec8cde19f213a7ed85"
format_stamp: "Formatted at 2026-08-08 07:06:03 on dist-test-slave-zj8q"
server_key: "3e36a96c40973eab56d4faf2312631ed"
server_key_iv: "9aa0d490b7b8e155d254452663134823"
server_key_version: "encryptionkey@0"
I20260808 07:06:03.474901 28723 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 07:06:03.475560 28742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.475735 28723 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:03.475823 28723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "b1942954c5b44eec8cde19f213a7ed85"
format_stamp: "Formatted at 2026-08-08 07:06:03 on dist-test-slave-zj8q"
server_key: "3e36a96c40973eab56d4faf2312631ed"
server_key_iv: "9aa0d490b7b8e155d254452663134823"
server_key_version: "encryptionkey@0"
I20260808 07:06:03.475879 28723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:03.485872 28723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:03.487574 28723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:03.487680 28723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:03.491462 28723 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:33275
I20260808 07:06:03.491492 28829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:33275 every 8 connection(s)
I20260808 07:06:03.491792 28723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:03.492574 28831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:03.493176 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28723
I20260808 07:06:03.493275 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:03.493428 26718 external_mini_cluster.cc:1428] Setting key 141c83466abd14817cfed0d81b0c1bc7
I20260808 07:06:03.495544 28831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85: Bootstrap starting.
I20260808 07:06:03.496218 28831 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:03.496512 28831 log.cc:824] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:03.497152 28831 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85: No bootstrap required, opened a new log
I20260808 07:06:03.499228 28838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.493969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45015 (local address 127.26.23.190:33275)
0808 07:06:03.494178 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.494188 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.494222 (+ 34us) server_negotiation.cc:407] Connection header received
0808 07:06:03.494722 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.494732 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.494796 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.494941 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.495171 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.496423 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.497209 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.497801 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.497907 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.498542 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.498546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.498547 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:03.498751 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.498798 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:03.498813 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.498910 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.498987 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.499014 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260808 07:06:03.499445 28831 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1942954c5b44eec8cde19f213a7ed85" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33275 } }
I20260808 07:06:03.499585 28831 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:03.499619 28831 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1942954c5b44eec8cde19f213a7ed85, State: Initialized, Role: FOLLOWER
I20260808 07:06:03.499727 28831 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1942954c5b44eec8cde19f213a7ed85" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33275 } }
I20260808 07:06:03.499811 28831 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:03.499853 28831 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:03.499935 28831 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:03.500207 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:03.500519 28831 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1942954c5b44eec8cde19f213a7ed85" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33275 } }
I20260808 07:06:03.500608 28831 leader_election.cc:302] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1942954c5b44eec8cde19f213a7ed85; no voters:
I20260808 07:06:03.500763 28831 leader_election.cc:288] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:03.500819 28841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:03.500986 28831 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:03.501022 28841 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [term 1 LEADER]: Becoming Leader. State: Replica: b1942954c5b44eec8cde19f213a7ed85, State: Running, Role: LEADER
I20260808 07:06:03.501183 28841 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1942954c5b44eec8cde19f213a7ed85" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33275 } }
I20260808 07:06:03.501554 28842 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1942954c5b44eec8cde19f213a7ed85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1942954c5b44eec8cde19f213a7ed85" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33275 } } }
I20260808 07:06:03.501612 28844 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1942954c5b44eec8cde19f213a7ed85. Latest consensus state: current_term: 1 leader_uuid: "b1942954c5b44eec8cde19f213a7ed85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1942954c5b44eec8cde19f213a7ed85" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 33275 } } }
I20260808 07:06:03.501678 28842 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:03.501698 28844 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:03.502036 28863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:03.502540 28863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:03.503893 28863 catalog_manager.cc:1347] Generated new cluster ID: a2b771d400284887842c2b0b5037754f
I20260808 07:06:03.503942 28863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:03.505379 28838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:03.501557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57655 (local address 127.26.23.190:33275)
0808 07:06:03.501740 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:03.501742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:03.502035 (+ 293us) server_negotiation.cc:407] Connection header received
0808 07:06:03.502126 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:03.502126 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:03.502136 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:03.502186 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:03.502424 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.503089 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.504150 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:03.504455 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:03.504520 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:03.505148 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:03.505149 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:03.505150 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:03.505154 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:03.505168 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:03.505172 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:03.505221 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:03.505299 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 07:06:03.505308 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260808 07:06:03.516976 28863 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:03.517428 28863 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:03.519371 28863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1942954c5b44eec8cde19f213a7ed85: Generated new TSK 0
I20260808 07:06:03.519536 28863 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:03.522519 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28723
W20260808 07:06:03.534397 28700 connection.cc:535] client connection to 127.26.23.190:33275 recv error: Network error: failed to read from TLS socket (remote: 127.26.23.190:33275): Connection reset by peer (error 104)
2026-08-08T07:06:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1413 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:03 dist-test-slave-zj8q krb5kdc[28886](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:03 dist-test-slave-zj8q krb5kdc[28886](info): set up 2 sockets
Aug 08 07:06:03 dist-test-slave-zj8q krb5kdc[28886](info): commencing operation
krb5kdc: starting...
W20260808 07:06:04.672060 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:04 dist-test-slave-zj8q krb5kdc[28886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:04.793907 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43873
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38311
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:43873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:04.874897 28901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:04.875092 28901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:04.875123 28901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:04.876217 28901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:04.876257 28901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:04.876276 28901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:04.876292 28901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:04.876308 28901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:04.877758 28901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38311
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:43873
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:43873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:04.877990 28901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:04.878211 28901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:04.883024 28911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:04.883069 28915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:04.883242 28908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:04.883248 28901 server_base.cc:1034] running on GCE node
I20260808 07:06:04.883504 28901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:04.883787 28901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:04.884927 28901 hybrid_clock.cc:648] HybridClock initialized: now 1786172764884906 us; error 39 us; skew 500 ppm
Aug 08 07:06:04 dist-test-slave-zj8q krb5kdc[28886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172764, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:04.887324 28901 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:04.887760 28901 webserver.cc:460] Webserver started at http://127.26.23.190:37311/ using document root <none> and password file <none>
I20260808 07:06:04.887966 28901 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:04.888013 28901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:04.888134 28901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:04.889118 28901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "52065f2181094bb08d7309cc96959ff6"
format_stamp: "Formatted at 2026-08-08 07:06:04 on dist-test-slave-zj8q"
server_key: "34f0ebc4ed5617d4fcb07202eb972fb8"
server_key_iv: "6b11b77866e75c7f6ee70a705c845d23"
server_key_version: "encryptionkey@0"
I20260808 07:06:04.889447 28901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "52065f2181094bb08d7309cc96959ff6"
format_stamp: "Formatted at 2026-08-08 07:06:04 on dist-test-slave-zj8q"
server_key: "34f0ebc4ed5617d4fcb07202eb972fb8"
server_key_iv: "6b11b77866e75c7f6ee70a705c845d23"
server_key_version: "encryptionkey@0"
I20260808 07:06:04.890722 28901 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 07:06:04.891369 28924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:04.891521 28901 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:04.891605 28901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "52065f2181094bb08d7309cc96959ff6"
format_stamp: "Formatted at 2026-08-08 07:06:04 on dist-test-slave-zj8q"
server_key: "34f0ebc4ed5617d4fcb07202eb972fb8"
server_key_iv: "6b11b77866e75c7f6ee70a705c845d23"
server_key_version: "encryptionkey@0"
I20260808 07:06:04.891690 28901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:04.894865 28901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:04.896890 28901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:04.897019 28901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:04.900820 28901 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:43873
I20260808 07:06:04.900851 29008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:43873 every 8 connection(s)
I20260808 07:06:04.901137 28901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:04.902063 29010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:04.904295 29010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6: Bootstrap starting.
I20260808 07:06:04.904839 29010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:04.905084 29010 log.cc:824] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:04.905720 29010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6: No bootstrap required, opened a new log
I20260808 07:06:04.907357 29010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52065f2181094bb08d7309cc96959ff6" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43873 } }
I20260808 07:06:04.907498 29010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:04.907521 29010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52065f2181094bb08d7309cc96959ff6, State: Initialized, Role: FOLLOWER
I20260808 07:06:04.907648 29010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52065f2181094bb08d7309cc96959ff6" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43873 } }
I20260808 07:06:04.907703 29010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:04.907734 29010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:04.907778 29010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:04.908558 29010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52065f2181094bb08d7309cc96959ff6" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43873 } }
I20260808 07:06:04.908648 29010 leader_election.cc:302] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52065f2181094bb08d7309cc96959ff6; no voters:
I20260808 07:06:04.908778 29010 leader_election.cc:288] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:04.908839 29015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:04.908914 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 28901
I20260808 07:06:04.909010 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:04.909016 29010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:04.909049 29015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [term 1 LEADER]: Becoming Leader. State: Replica: 52065f2181094bb08d7309cc96959ff6, State: Running, Role: LEADER
I20260808 07:06:04.909183 26718 external_mini_cluster.cc:1428] Setting key 1edac1eec77c3dfed69a5828c1bd0592
I20260808 07:06:04.909157 29015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52065f2181094bb08d7309cc96959ff6" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43873 } }
I20260808 07:06:04.909511 29019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52065f2181094bb08d7309cc96959ff6. Latest consensus state: current_term: 1 leader_uuid: "52065f2181094bb08d7309cc96959ff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52065f2181094bb08d7309cc96959ff6" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43873 } } }
I20260808 07:06:04.909670 29019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:04.909940 29035 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:04.910180 29018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52065f2181094bb08d7309cc96959ff6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52065f2181094bb08d7309cc96959ff6" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 43873 } } }
I20260808 07:06:04.910317 29018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:04.910490 29035 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:04.911463 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:04.909848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46255 (local address 127.26.23.190:43873)
0808 07:06:04.910020 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:04.910029 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:04.910059 (+ 30us) server_negotiation.cc:407] Connection header received
0808 07:06:04.910265 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:04.910272 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:04.910305 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:04.910476 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:04.911092 (+ 616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:04.911095 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:04.911095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:04.911099 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:04.911157 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:04.911168 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:04.911224 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:04.911309 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 07:06:04.911340 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260808 07:06:04.912365 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:04.914547 29036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:04.913610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46643 (local address 127.26.23.190:43873)
0808 07:06:04.913651 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:04.913653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:04.913764 (+ 111us) server_negotiation.cc:407] Connection header received
0808 07:06:04.913813 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:04.913814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:04.913819 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:04.913870 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:04.914359 (+ 489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:04.914360 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:04.914361 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:04.914365 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:04.914379 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:04.914383 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:04.914429 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:04.914477 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 07:06:04.914489 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:06:04.915525 29035 catalog_manager.cc:1347] Generated new cluster ID: 3e155450ecdb46d68b4b7209a0a8a9be
I20260808 07:06:04.915625 29035 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:04.947404 29035 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:04.947623 29035 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:04.951990 29035 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52065f2181094bb08d7309cc96959ff6: Generated new TSK 0
I20260808 07:06:04.952181 29035 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:04.963759 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 28901
2026-08-08T07:06:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:05 dist-test-slave-zj8q krb5kdc[29058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:05 dist-test-slave-zj8q krb5kdc[29058](info): set up 2 sockets
Aug 08 07:06:05 dist-test-slave-zj8q krb5kdc[29058](info): commencing operation
krb5kdc: starting...
W20260808 07:06:06.129841 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:06 dist-test-slave-zj8q krb5kdc[29058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:06.246775 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:44385
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:44385
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:06.328744 29081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:06.328943 29081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:06.328965 29081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:06.330063 29081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:06.330097 29081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:06.330111 29081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:06.330121 29081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:06.330132 29081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:06.331594 29081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:44385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:44385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:06.331780 29081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:06.331951 29081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:06.336802 29086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:06.336782 29089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:06.336870 29081 server_base.cc:1034] running on GCE node
W20260808 07:06:06.336777 29087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:06.337167 29081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:06.337443 29081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:06.338587 29081 hybrid_clock.cc:648] HybridClock initialized: now 1786172766338561 us; error 39 us; skew 500 ppm
Aug 08 07:06:06 dist-test-slave-zj8q krb5kdc[29058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:06.340958 29081 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:06.341369 29081 webserver.cc:460] Webserver started at http://127.26.23.190:36205/ using document root <none> and password file <none>
I20260808 07:06:06.341557 29081 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:06.341599 29081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:06.341714 29081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:06.342767 29081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "587cb9dd8349489c88262ed8563bc583"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-zj8q"
server_key: "35d2bd1f75d4a81b3a64b61fb4df0951"
server_key_iv: "1ae12544fb88aec5bf33f865ec9dc176"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.343094 29081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "587cb9dd8349489c88262ed8563bc583"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-zj8q"
server_key: "35d2bd1f75d4a81b3a64b61fb4df0951"
server_key_iv: "1ae12544fb88aec5bf33f865ec9dc176"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.344292 29081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 07:06:06.344921 29101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:06.345070 29081 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:06.345147 29081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "587cb9dd8349489c88262ed8563bc583"
format_stamp: "Formatted at 2026-08-08 07:06:06 on dist-test-slave-zj8q"
server_key: "35d2bd1f75d4a81b3a64b61fb4df0951"
server_key_iv: "1ae12544fb88aec5bf33f865ec9dc176"
server_key_version: "encryptionkey@0"
I20260808 07:06:06.345212 29081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:06.359897 29081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:06.361583 29081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:06.361707 29081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:06.365533 29081 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:44385
I20260808 07:06:06.365574 29179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:44385 every 8 connection(s)
I20260808 07:06:06.365895 29081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:06.366777 29181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:06.368952 29181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583: Bootstrap starting.
I20260808 07:06:06.369503 29181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:06.369761 29181 log.cc:824] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:06.370513 29181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583: No bootstrap required, opened a new log
I20260808 07:06:06.371551 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29081
I20260808 07:06:06.371639 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:06.371786 26718 external_mini_cluster.cc:1428] Setting key 1ff897355ffe8231104e9c359ef5237b
I20260808 07:06:06.372349 29181 raft_consensus.cc:348] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587cb9dd8349489c88262ed8563bc583" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44385 } }
I20260808 07:06:06.372521 29181 raft_consensus.cc:374] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:06.372567 29181 raft_consensus.cc:729] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 587cb9dd8349489c88262ed8563bc583, State: Initialized, Role: FOLLOWER
I20260808 07:06:06.372694 29181 consensus_queue.cc:260] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587cb9dd8349489c88262ed8563bc583" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44385 } }
I20260808 07:06:06.372776 29181 raft_consensus.cc:388] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:06.372855 29181 raft_consensus.cc:482] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:06.372916 29181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:06.373550 29181 raft_consensus.cc:504] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587cb9dd8349489c88262ed8563bc583" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44385 } }
I20260808 07:06:06.373667 29181 leader_election.cc:302] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 587cb9dd8349489c88262ed8563bc583; no voters:
I20260808 07:06:06.373817 29181 leader_election.cc:288] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:06.373870 29187 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:06.374007 29187 raft_consensus.cc:686] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [term 1 LEADER]: Becoming Leader. State: Replica: 587cb9dd8349489c88262ed8563bc583, State: Running, Role: LEADER
I20260808 07:06:06.374054 29181 sys_catalog.cc:564] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:06.374145 29187 consensus_queue.cc:237] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587cb9dd8349489c88262ed8563bc583" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44385 } }
I20260808 07:06:06.374507 29187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 587cb9dd8349489c88262ed8563bc583. Latest consensus state: current_term: 1 leader_uuid: "587cb9dd8349489c88262ed8563bc583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587cb9dd8349489c88262ed8563bc583" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44385 } } }
I20260808 07:06:06.374577 29191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "587cb9dd8349489c88262ed8563bc583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "587cb9dd8349489c88262ed8563bc583" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 44385 } } }
I20260808 07:06:06.374647 29187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:06.374653 29191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:06.374894 29201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:06.375437 29201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:06.377038 29201 catalog_manager.cc:1347] Generated new cluster ID: 1df7d2ade88643f98007e41c706ffe5c
I20260808 07:06:06.377089 29201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 07:06:06 dist-test-slave-zj8q krb5kdc[29058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:06.381574 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.372282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40495 (local address 127.26.23.190:44385)
0808 07:06:06.372475 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:06.372484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:06.372517 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:06:06.372639 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:06.372646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:06.372699 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:06.372838 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:06.373472 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.374811 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.375845 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.376338 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.376435 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.378710 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:06.378714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:06.378714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:06.378726 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:06.380191 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.380503 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.380506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.380506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.380598 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.380780 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.380781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.380781 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.381013 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:06.381172 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:06.381262 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 07:06:06.381393 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":92,"threads_started":1}
I20260808 07:06:06.382624 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:06.383234 29201 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:06.383884 29201 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:06.388820 29201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 587cb9dd8349489c88262ed8563bc583: Generated new TSK 0
I20260808 07:06:06.389009 29201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:06.389349 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:06.383972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55113 (local address 127.26.23.190:44385)
0808 07:06:06.384006 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:06.384007 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:06.384113 (+ 106us) server_negotiation.cc:407] Connection header received
0808 07:06:06.384172 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:06.384172 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:06.384193 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:06.384236 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:06.384696 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.385157 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.385840 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:06.386045 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:06.386096 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:06.387099 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:06.387100 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:06.387101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:06.387114 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:06.388276 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.388623 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.388624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.388625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.388678 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:06.388880 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:06.388881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:06.388881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:06.389000 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:06.389096 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:06.389235 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 07:06:06.389296 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:06:06.390969 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29081
2026-08-08T07:06:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:06 dist-test-slave-zj8q krb5kdc[29230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:06 dist-test-slave-zj8q krb5kdc[29230](info): set up 2 sockets
Aug 08 07:06:06 dist-test-slave-zj8q krb5kdc[29230](info): commencing operation
krb5kdc: starting...
W20260808 07:06:07.535319 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:07 dist-test-slave-zj8q krb5kdc[29230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:07.651207 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46687
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:38729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:46687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:07.731804 29252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:07.732019 29252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:07.732050 29252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:07.733202 29252 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:07.733248 29252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:07.733268 29252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:07.733282 29252 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:07.733299 29252 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:07.734864 29252 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:38729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:46687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:07.735121 29252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:07.735338 29252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:07.740131 29258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:07.740137 29264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.740315 29252 server_base.cc:1034] running on GCE node
W20260808 07:06:07.740381 29260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:07.740644 29252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:07.740933 29252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:07.742123 29252 hybrid_clock.cc:648] HybridClock initialized: now 1786172767742101 us; error 32 us; skew 500 ppm
Aug 08 07:06:07 dist-test-slave-zj8q krb5kdc[29230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172767, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:07.747653 29252 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:07.748200 29252 webserver.cc:460] Webserver started at http://127.26.23.190:35647/ using document root <none> and password file <none>
I20260808 07:06:07.748412 29252 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:07.748458 29252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:07.748593 29252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:07.749647 29252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "8e7e6d4752824a6dacafe9566fb26951"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-zj8q"
server_key: "a518d9fdfea0223b55dace1116f15a28"
server_key_iv: "1526a641ce8d9d6f6b61f224366d0401"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.749984 29252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "8e7e6d4752824a6dacafe9566fb26951"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-zj8q"
server_key: "a518d9fdfea0223b55dace1116f15a28"
server_key_iv: "1526a641ce8d9d6f6b61f224366d0401"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.751279 29252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:07.751951 29275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:07.752102 29252 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:07.752193 29252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "8e7e6d4752824a6dacafe9566fb26951"
format_stamp: "Formatted at 2026-08-08 07:06:07 on dist-test-slave-zj8q"
server_key: "a518d9fdfea0223b55dace1116f15a28"
server_key_iv: "1526a641ce8d9d6f6b61f224366d0401"
server_key_version: "encryptionkey@0"
I20260808 07:06:07.752255 29252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:07.767057 29252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:07.768822 29252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:07.768931 29252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:07.772769 29252 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:46687
I20260808 07:06:07.772822 29360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:46687 every 8 connection(s)
I20260808 07:06:07.773135 29252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:07.774091 29361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:07.775902 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29252
I20260808 07:06:07.775990 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:07.776165 26718 external_mini_cluster.cc:1428] Setting key 8f32f3d7d48a08117ff0e43b3cdb7002
I20260808 07:06:07.776594 29361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951: Bootstrap starting.
I20260808 07:06:07.777349 29361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:07.777706 29361 log.cc:824] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:07.778514 29361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951: No bootstrap required, opened a new log
I20260808 07:06:07.780674 29361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7e6d4752824a6dacafe9566fb26951" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46687 } }
I20260808 07:06:07.780836 29361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:07.780898 29361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7e6d4752824a6dacafe9566fb26951, State: Initialized, Role: FOLLOWER
I20260808 07:06:07.781028 29361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7e6d4752824a6dacafe9566fb26951" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46687 } }
I20260808 07:06:07.781119 29361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:07.781164 29361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:07.781210 29361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:07.781752 29361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7e6d4752824a6dacafe9566fb26951" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46687 } }
I20260808 07:06:07.781883 29361 leader_election.cc:302] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e7e6d4752824a6dacafe9566fb26951; no voters:
I20260808 07:06:07.781886 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.776657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42911 (local address 127.26.23.190:46687)
0808 07:06:07.776840 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.776849 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.776880 (+ 31us) server_negotiation.cc:407] Connection header received
0808 07:06:07.777440 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.777450 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.777519 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.777669 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.777830 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.779121 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.779904 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.780552 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.780659 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.781310 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:07.781315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:07.781315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:07.781478 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:07.781508 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:07.781519 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:07.781573 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:07.781659 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 07:06:07.781726 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":78,"threads_started":1}
I20260808 07:06:07.782069 29361 leader_election.cc:288] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:07.782100 29374 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:07.782266 29374 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [term 1 LEADER]: Becoming Leader. State: Replica: 8e7e6d4752824a6dacafe9566fb26951, State: Running, Role: LEADER
I20260808 07:06:07.782326 29361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:07.782356 29374 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7e6d4752824a6dacafe9566fb26951" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46687 } }
I20260808 07:06:07.782737 29374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e7e6d4752824a6dacafe9566fb26951. Latest consensus state: current_term: 1 leader_uuid: "8e7e6d4752824a6dacafe9566fb26951" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7e6d4752824a6dacafe9566fb26951" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46687 } } }
I20260808 07:06:07.782744 29375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e7e6d4752824a6dacafe9566fb26951" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e7e6d4752824a6dacafe9566fb26951" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46687 } } }
I20260808 07:06:07.782852 29374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:07.782910 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:07.782863 29375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951 [sys.catalog]: This master's current role is: LEADER
W20260808 07:06:07.784226 29397 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:07.784338 29397 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:07.784440 29386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:07.784628 29386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:07.785959 29386 catalog_manager.cc:1347] Generated new cluster ID: 08d51285a14a46e0b62afa9cf2e21778
I20260808 07:06:07.786005 29386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:07.787664 29368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:07.784302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33613 (local address 127.26.23.190:46687)
0808 07:06:07.784336 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:07.784337 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:07.784464 (+ 127us) server_negotiation.cc:407] Connection header received
0808 07:06:07.784516 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:07.784517 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:07.784526 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:07.784583 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:07.784719 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.785415 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.786452 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:07.786736 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:07.786778 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:07.787435 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:07.787437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:07.787437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:07.787441 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:07.787457 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:07.787460 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:07.787518 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:07.787572 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 07:06:07.787593 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:06:07.793274 29386 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:07.793748 29386 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:07.803562 29386 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e7e6d4752824a6dacafe9566fb26951: Generated new TSK 0
I20260808 07:06:07.803756 29386 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:07.809365 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29252
2026-08-08T07:06:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:07 dist-test-slave-zj8q krb5kdc[29411](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:07 dist-test-slave-zj8q krb5kdc[29411](info): set up 2 sockets
Aug 08 07:06:07 dist-test-slave-zj8q krb5kdc[29411](info): commencing operation
krb5kdc: starting...
W20260808 07:06:08.961593 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:09 dist-test-slave-zj8q krb5kdc[29411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:09.076851 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46463
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:35427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:46463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:09.158748 29428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:09.158948 29428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:09.158979 29428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:09.160125 29428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:09.160168 29428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:09.160188 29428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:09.160203 29428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:09.160219 29428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:09.161695 29428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:35427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:46463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:09.161929 29428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:09.162144 29428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:09.166814 29437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:09.166898 29438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:09.166899 29428 server_base.cc:1034] running on GCE node
W20260808 07:06:09.166899 29440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:09.167245 29428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:09.167513 29428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:09.168665 29428 hybrid_clock.cc:648] HybridClock initialized: now 1786172769168646 us; error 34 us; skew 500 ppm
Aug 08 07:06:09 dist-test-slave-zj8q krb5kdc[29411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172769, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:09.171037 29428 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:09.171464 29428 webserver.cc:460] Webserver started at http://127.26.23.190:36309/ using document root <none> and password file <none>
I20260808 07:06:09.171693 29428 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:09.171739 29428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:09.171864 29428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:09.172866 29428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "6a6883e30f50492ba70595a3cf146bae"
format_stamp: "Formatted at 2026-08-08 07:06:09 on dist-test-slave-zj8q"
server_key: "38aeb90a4f08851d449808bd32bb1874"
server_key_iv: "c5fa4b201a59f14518d355268a036468"
server_key_version: "encryptionkey@0"
I20260808 07:06:09.173193 29428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "6a6883e30f50492ba70595a3cf146bae"
format_stamp: "Formatted at 2026-08-08 07:06:09 on dist-test-slave-zj8q"
server_key: "38aeb90a4f08851d449808bd32bb1874"
server_key_iv: "c5fa4b201a59f14518d355268a036468"
server_key_version: "encryptionkey@0"
I20260808 07:06:09.174434 29428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 07:06:09.175081 29452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:09.175225 29428 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:09.175292 29428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "6a6883e30f50492ba70595a3cf146bae"
format_stamp: "Formatted at 2026-08-08 07:06:09 on dist-test-slave-zj8q"
server_key: "38aeb90a4f08851d449808bd32bb1874"
server_key_iv: "c5fa4b201a59f14518d355268a036468"
server_key_version: "encryptionkey@0"
I20260808 07:06:09.175354 29428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:09.178851 29428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:09.180599 29428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:09.180711 29428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:09.184536 29428 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:46463
I20260808 07:06:09.184597 29531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:46463 every 8 connection(s)
I20260808 07:06:09.184854 29428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:09.185765 29533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:09.187908 29533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae: Bootstrap starting.
I20260808 07:06:09.188443 29533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:09.188670 29533 log.cc:824] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:09.189289 29533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae: No bootstrap required, opened a new log
I20260808 07:06:09.190887 29533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6883e30f50492ba70595a3cf146bae" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46463 } }
I20260808 07:06:09.191045 29533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 07:06:09.191068 29533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a6883e30f50492ba70595a3cf146bae, State: Initialized, Role: FOLLOWER
I20260808 07:06:09.191175 29533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6883e30f50492ba70595a3cf146bae" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46463 } }
I20260808 07:06:09.191254 29533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 07:06:09.191293 29533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 07:06:09.191341 29533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:09.191331 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29428
I20260808 07:06:09.191426 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:09.191663 26718 external_mini_cluster.cc:1428] Setting key 128493206522af376eb222971891325e
I20260808 07:06:09.192346 29533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6883e30f50492ba70595a3cf146bae" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46463 } }
I20260808 07:06:09.192461 29533 leader_election.cc:302] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a6883e30f50492ba70595a3cf146bae; no voters:
I20260808 07:06:09.192620 29533 leader_election.cc:288] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 07:06:09.192662 29541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:09.192864 29541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [term 1 LEADER]: Becoming Leader. State: Replica: 6a6883e30f50492ba70595a3cf146bae, State: Running, Role: LEADER
I20260808 07:06:09.193013 29541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6883e30f50492ba70595a3cf146bae" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46463 } }
I20260808 07:06:09.192866 29533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:09.193560 29545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a6883e30f50492ba70595a3cf146bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6883e30f50492ba70595a3cf146bae" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46463 } } }
I20260808 07:06:09.193573 29548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a6883e30f50492ba70595a3cf146bae. Latest consensus state: current_term: 1 leader_uuid: "6a6883e30f50492ba70595a3cf146bae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a6883e30f50492ba70595a3cf146bae" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46463 } } }
I20260808 07:06:09.193729 29548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:09.193931 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:09.192175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37261 (local address 127.26.23.190:46463)
0808 07:06:09.192328 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:09.192337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:09.192370 (+ 33us) server_negotiation.cc:407] Connection header received
0808 07:06:09.192553 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:09.192560 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:09.192589 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:09.192727 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:09.193377 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:09.193381 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:09.193382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:09.193386 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:09.193424 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:09.193435 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:09.193487 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:09.193698 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 07:06:09.193739 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":75,"threads_started":1}
I20260808 07:06:09.193935 29545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:09.194521 29562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:09.194988 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:09.195252 29562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:09.197379 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:09.196487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36297 (local address 127.26.23.190:46463)
0808 07:06:09.196517 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:09.196519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:09.196611 (+ 92us) server_negotiation.cc:407] Connection header received
0808 07:06:09.196662 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:09.196663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:09.196668 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:09.196720 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:09.197193 (+ 473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:09.197194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:09.197194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 07:06:09.197198 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:09.197213 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 07:06:09.197217 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:09.197271 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:09.197308 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 07:06:09.197321 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:06:09.198556 29562 catalog_manager.cc:1347] Generated new cluster ID: 12d4109afa684427967a263425d5266b
I20260808 07:06:09.198603 29562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:09.209213 29562 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:09.209365 29562 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:09.212222 29562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a6883e30f50492ba70595a3cf146bae: Generated new TSK 0
I20260808 07:06:09.212378 29562 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:09.218902 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29428
2026-08-08T07:06:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1408 ms)
[----------] 18 tests from AuthTokenIssuingTest (25634 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:09 dist-test-slave-zj8q krb5kdc[29584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:09 dist-test-slave-zj8q krb5kdc[29584](info): set up 2 sockets
Aug 08 07:06:09 dist-test-slave-zj8q krb5kdc[29584](info): commencing operation
krb5kdc: starting...
W20260808 07:06:10.360296 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:10.477505 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:36895
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:36895,127.26.23.189:33287,127.26.23.188:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:10.558109 29603 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:06:10.558334 29603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:10.558351 29603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:10.558368 29603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:10.559413 29603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:10.559448 29603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:10.559460 29603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:10.559471 29603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:10.559481 29603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:10.560879 29603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:36895,127.26.23.189:33287,127.26.23.188:38387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:36895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:10.561065 29603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:10.561236 29603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:10.566052 29610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:10.566061 29615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:10.566047 29621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:10.566460 29603 server_base.cc:1034] running on GCE node
I20260808 07:06:10.566708 29603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:10.566988 29603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:10.568131 29603 hybrid_clock.cc:648] HybridClock initialized: now 1786172770568119 us; error 30 us; skew 500 ppm
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:10.570672 29603 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:10.571134 29603 webserver.cc:460] Webserver started at http://127.26.23.190:33193/ using document root <none> and password file <none>
I20260808 07:06:10.571338 29603 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:10.571388 29603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:10.571513 29603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:10.572566 29603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "9d9b4cc7bebd460fab59679edfb7aa3a"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "8103fc7da99b5fa39678823448cb91a1"
server_key_iv: "3f7bbdef56e3ab6393ee1e2daaf04d3f"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.572912 29603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "9d9b4cc7bebd460fab59679edfb7aa3a"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "8103fc7da99b5fa39678823448cb91a1"
server_key_iv: "3f7bbdef56e3ab6393ee1e2daaf04d3f"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.574216 29603 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:06:10.574975 29637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:10.575208 29603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:10.575305 29603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "9d9b4cc7bebd460fab59679edfb7aa3a"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "8103fc7da99b5fa39678823448cb91a1"
server_key_iv: "3f7bbdef56e3ab6393ee1e2daaf04d3f"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.575374 29603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:10.586613 29603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:10.588658 29603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:10.588791 29603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:10.592769 29603 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:36895
I20260808 07:06:10.592803 29715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:36895 every 8 connection(s)
I20260808 07:06:10.593120 29603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:10.594033 29716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:10.595582 29716 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:10.602113 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29603
I20260808 07:06:10.602257 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:10.602463 26718 external_mini_cluster.cc:1428] Setting key ab29d65783b17589bc52a81e62e1bb8b
I20260808 07:06:10.605134 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.596231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58624 (local address 127.26.23.190:36895)
0808 07:06:10.596386 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.596395 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.596466 (+ 71us) server_negotiation.cc:407] Connection header received
0808 07:06:10.596985 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.596987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.597004 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.597120 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.597831 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.598792 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.599641 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.599942 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.600013 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.601992 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.602001 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.602001 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.602009 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.603648 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.603987 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.603990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.603991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.604122 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.604360 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.604360 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.604361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.604586 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.604647 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.604850 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.604942 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260808 07:06:10.605146 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.596194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:36895 (local address 127.0.0.1:58624)
0808 07:06:10.596351 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.596388 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.596835 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.597158 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.597161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.597503 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.597741 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.597748 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.598887 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.598888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.599570 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.599572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.600013 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.600014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.600065 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.600502 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.600510 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.601912 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.603723 (+ 1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.603730 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.603732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.603916 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.604184 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.604185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.604185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.604293 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.604645 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.604651 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.604725 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.604820 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.605016 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":45,"thread_start_us":75,"threads_started":1}
I20260808 07:06:10.606129 29716 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:10.606491 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.606371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56054)
0808 07:06:10.606416 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.606467 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:06:10.606637 29645 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
I20260808 07:06:10.607039 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.606936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56056)
0808 07:06:10.606984 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.607016 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:06:10.607142 29716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:33287: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.23.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab.
Entry for principal kudu/127.26.23.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab.
I20260808 07:06:10.627156 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:33287
--webserver_interface=127.26.23.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab
--principal=kudu/127.26.23.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:36895,127.26.23.189:33287,127.26.23.188:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:06:10.656354 29716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } attempt: 1
I20260808 07:06:10.656822 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.656700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56062)
0808 07:06:10.656760 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.656791 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:06:10.657150 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.657052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56078)
0808 07:06:10.657088 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.657111 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:06:10.657241 29716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:33287: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
W20260808 07:06:10.707470 29726 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:06:10.707679 29726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:10.707703 29726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:10.707732 29726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:10.708839 29726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:10.708879 29726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:10.708899 29726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:10.708913 29726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:10.708930 29726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:10.710462 29726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:36895,127.26.23.189:33287,127.26.23.188:38387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab
--principal=kudu/127.26.23.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:33287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.23.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:10.710703 29726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:10.710903 29726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:10.715607 29740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:10.715619 29734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:10.715621 29733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:10.715821 29726 server_base.cc:1034] running on GCE node
I20260808 07:06:10.716133 29726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:10.716398 29726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:10.717561 29726 hybrid_clock.cc:648] HybridClock initialized: now 1786172770717543 us; error 28 us; skew 500 ppm
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:10.720041 29726 init.cc:377] Logged in from keytab as kudu/127.26.23.189@KRBTEST.COM (short username kudu)
I20260808 07:06:10.720446 29726 webserver.cc:460] Webserver started at http://127.26.23.189:38251/ using document root <none> and password file <none>
I20260808 07:06:10.720633 29726 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:10.720672 29726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:10.720763 29726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:10.721725 29726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data/instance:
uuid: "93c965944241404ea777425d195400df"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "952e473210dfc61450e5fa112773d279"
server_key_iv: "254e107f48c19e01e51cd68e92626e85"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.722012 29726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal/instance:
uuid: "93c965944241404ea777425d195400df"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "952e473210dfc61450e5fa112773d279"
server_key_iv: "254e107f48c19e01e51cd68e92626e85"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.723233 29726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 07:06:10.723897 29753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:10.724056 29726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:10.724146 29726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal
uuid: "93c965944241404ea777425d195400df"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "952e473210dfc61450e5fa112773d279"
server_key_iv: "254e107f48c19e01e51cd68e92626e85"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.724202 29726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:10.725397 29716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } attempt: 2
I20260808 07:06:10.725813 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.725691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56080)
0808 07:06:10.725749 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.725784 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 07:06:10.726097 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.726033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56090)
0808 07:06:10.726059 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.726082 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 07:06:10.726207 29716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:33287: Network error: Client connection negotiation failed: client connection to 127.26.23.189:33287: connect: Connection refused (error 111)
I20260808 07:06:10.744979 29726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:10.746819 29726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:10.746937 29726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:10.750634 29726 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.189:33287
I20260808 07:06:10.750687 29836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.189:33287 every 8 connection(s)
I20260808 07:06:10.751008 29726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
I20260808 07:06:10.751595 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29726
I20260808 07:06:10.751725 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-1/wal/instance
I20260808 07:06:10.751917 26718 external_mini_cluster.cc:1428] Setting key bf046d183af5ec3e7acfd03b0d59f853
I20260808 07:06:10.752048 29837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:10.753686 29837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.26.23.188@KRBTEST.COM; defaulting to no policy
I20260808 07:06:10.762447 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.754483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58626 (local address 127.26.23.190:36895)
0808 07:06:10.754544 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.754546 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.754733 (+ 187us) server_negotiation.cc:407] Connection header received
0808 07:06:10.755192 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.755193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.755207 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.755271 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.755971 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.756456 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.757418 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.757625 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.757680 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.759836 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.759838 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.759838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.759845 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.761093 (+ 1248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.761441 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.761442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.761442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.761496 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.761707 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.761708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.761708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.761866 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.761943 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.762290 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.762365 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.188@KRBTEST.COM" created.
I20260808 07:06:10.762704 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.754431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:36895 (local address 127.0.0.1:58626)
0808 07:06:10.754607 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.754648 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.755106 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.755371 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.755375 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.755680 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.755873 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.755877 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.756548 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.756549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.757333 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.757336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.757708 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.757710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.757836 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.758287 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.758295 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.759739 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.761166 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.761173 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.761175 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.761379 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.761545 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.761546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.761546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.761657 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.761958 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.761968 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.762127 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.762260 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.762408 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260808 07:06:10.763232 29837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:06:10.770787 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.763467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56094)
0808 07:06:10.763507 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.763525 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.763562 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.763834 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.763835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.763957 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.764002 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.764003 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.765164 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.765165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.765865 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.765868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.766452 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.766453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.766596 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.766946 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.766951 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.768216 (+ 1265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.769726 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.769727 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.769727 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.769928 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.770107 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.770107 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.770108 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.770194 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.770430 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.770431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.770477 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.770555 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.770661 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:06:10.770808 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.763503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56094 (local address 127.26.23.189:33287)
0808 07:06:10.763707 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.763711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.763728 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:06:10.763747 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.763749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.763761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.763822 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.764068 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.765068 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.765962 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.766370 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.766431 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.768297 (+ 1866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.768304 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.768304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.768310 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.769644 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.770002 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.770004 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.770005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.770050 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.770252 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.770252 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.770252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.770374 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.770434 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.770586 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.770711 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":178,"thread_start_us":151,"threads_started":1}
I20260808 07:06:10.771453 29837 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:10.771757 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.771652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45448)
0808 07:06:10.771692 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.771736 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 07:06:10.771875 29758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
I20260808 07:06:10.772289 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.772197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45462)
0808 07:06:10.772242 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.772266 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:06:10.772449 29837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:38387: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab.
Entry for principal kudu/127.26.23.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab.
I20260808 07:06:10.778638 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:38387
--webserver_interface=127.26.23.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab
--principal=kudu/127.26.23.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:45301
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:36895,127.26.23.189:33287,127.26.23.188:38387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:06:10.817384 29716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } attempt: 3
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:06:10.821693 29837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } attempt: 1
I20260808 07:06:10.822118 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.821978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45470)
0808 07:06:10.822033 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.822069 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:06:10.822474 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.822391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45482)
0808 07:06:10.822427 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.822451 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 07:06:10.822742 29837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:38387: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
I20260808 07:06:10.824345 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.817800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56108)
0808 07:06:10.817869 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.817880 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.817929 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.818063 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.818064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.818256 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.818324 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.818327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.819054 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.819055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.819575 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.819577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.819961 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.819962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.820034 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.820440 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.820444 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.821656 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.823429 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.823431 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.823431 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.823589 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.823815 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.823815 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.823816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.823862 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.824115 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.824116 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.824158 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.824207 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.824281 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 07:06:10.824412 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.817881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56108 (local address 127.26.23.189:33287)
0808 07:06:10.817953 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.817955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.817965 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:10.817993 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.817994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.818003 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.818051 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.818427 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.818972 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.819657 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.819899 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.819956 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.821732 (+ 1776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.821734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.821734 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.821742 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.823335 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.823687 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.823689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.823689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.823755 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.823908 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.823909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.823909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.824048 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.824110 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.824243 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.824326 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 07:06:10.824728 29716 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:10.825058 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.824931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45488)
0808 07:06:10.824982 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.825025 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:06:10.825348 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.825269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45500)
0808 07:06:10.825306 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.825331 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 07:06:10.825433 29716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:38387: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
I20260808 07:06:10.856585 29716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } attempt: 1
I20260808 07:06:10.857085 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.856939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45516)
0808 07:06:10.857001 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.857055 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:06:10.857438 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.857349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45526)
0808 07:06:10.857392 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.857417 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 07:06:10.857538 29716 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:38387: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
W20260808 07:06:10.862679 29847 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:06:10.862862 29847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:10.862887 29847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:10.862921 29847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:10.864012 29847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:10.864058 29847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:10.864077 29847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:10.864094 29847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:10.864115 29847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:10.865599 29847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:45301
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:36895,127.26.23.189:33287,127.26.23.188:38387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab
--principal=kudu/127.26.23.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:38387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.23.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:10.865823 29847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:10.866024 29847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:10.870582 29855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:10.870630 29854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:10.870810 29847 server_base.cc:1034] running on GCE node
W20260808 07:06:10.870678 29863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:10.871088 29847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:10.871356 29847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:10.872506 29847 hybrid_clock.cc:648] HybridClock initialized: now 1786172770872480 us; error 30 us; skew 500 ppm
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:10.874989 29847 init.cc:377] Logged in from keytab as kudu/127.26.23.188@KRBTEST.COM (short username kudu)
I20260808 07:06:10.875399 29847 webserver.cc:460] Webserver started at http://127.26.23.188:42221/ using document root <none> and password file <none>
I20260808 07:06:10.875610 29847 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:10.875654 29847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:10.875780 29847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:10.876793 29847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data/instance:
uuid: "3f7d61aaa04940299dd26847f406f297"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "b01bb3b7941c1a58b8c5f267592a6046"
server_key_iv: "ce75d3a764328ae41c9d35703b958f80"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.877122 29847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal/instance:
uuid: "3f7d61aaa04940299dd26847f406f297"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "b01bb3b7941c1a58b8c5f267592a6046"
server_key_iv: "ce75d3a764328ae41c9d35703b958f80"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.878412 29847 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 07:06:10.879081 29873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:10.879232 29847 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:10.879319 29847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal
uuid: "3f7d61aaa04940299dd26847f406f297"
format_stamp: "Formatted at 2026-08-08 07:06:10 on dist-test-slave-zj8q"
server_key: "b01bb3b7941c1a58b8c5f267592a6046"
server_key_iv: "ce75d3a764328ae41c9d35703b958f80"
server_key_version: "encryptionkey@0"
I20260808 07:06:10.879377 29847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:10.890878 29837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } attempt: 2
I20260808 07:06:10.891294 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.891182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45540)
0808 07:06:10.891231 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.891265 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 07:06:10.891579 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.891504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45556)
0808 07:06:10.891539 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.891561 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 07:06:10.891661 29837 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:38387: Network error: Client connection negotiation failed: client connection to 127.26.23.188:38387: connect: Connection refused (error 111)
I20260808 07:06:10.898559 29847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:10.900561 29847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:10.900671 29847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:10.904552 29847 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.188:38387
I20260808 07:06:10.904589 29960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.188:38387 every 8 connection(s)
I20260808 07:06:10.904907 29847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
I20260808 07:06:10.905876 29961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:10.907377 29961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:10.913802 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 29847
I20260808 07:06:10.913908 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786172503363962-26718-0/minicluster-data/master-2/wal/instance
I20260808 07:06:10.914110 26718 external_mini_cluster.cc:1428] Setting key 9a31999dbe36307292efd84d73004a6c
I20260808 07:06:10.915692 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.908002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58632 (local address 127.26.23.190:36895)
0808 07:06:10.908052 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.908054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.908254 (+ 200us) server_negotiation.cc:407] Connection header received
0808 07:06:10.908680 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.908681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.908689 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.908742 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.909288 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.909751 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.910693 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.910872 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.910920 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.912793 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.912794 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.912795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.912801 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.914179 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.914696 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.914697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.914698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.914763 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.915032 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.915032 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.915032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.915159 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.915209 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.915521 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.915603 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:06:10.915858 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.907958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:36895 (local address 127.0.0.1:58632)
0808 07:06:10.908144 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.908185 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.908607 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.908790 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.908794 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.909017 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.909224 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.909229 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.909805 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.909805 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.910632 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.910635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.910934 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.910935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.911043 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.911428 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.911438 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.912709 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.914261 (+ 1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.914269 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.914271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.914607 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.914829 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.914830 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.914830 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.914971 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.915218 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.915225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.915388 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.915508 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.915666 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260808 07:06:10.916383 29961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:06:10.922871 29971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.914486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.26.23.188:38387)
0808 07:06:10.914674 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.914678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.914724 (+ 46us) server_negotiation.cc:407] Connection header received
0808 07:06:10.914746 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.914748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.914761 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.914831 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.915542 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.916481 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.917387 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.917672 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.917738 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.920188 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.920197 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.920197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.920204 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.921658 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.922020 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.922022 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.922023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.922118 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.922328 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.922329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.922329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.922481 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.922609 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.922697 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.922769 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":159,"thread_start_us":68,"threads_started":1}
I20260808 07:06:10.922997 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.916691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56118 (local address 127.26.23.189:33287)
0808 07:06:10.916747 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.916749 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.916756 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:06:10.916780 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.916781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.916790 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.916852 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.917064 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.917637 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.918368 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.918708 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.918784 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.920635 (+ 1851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.920636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.920637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.920644 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.921948 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.922311 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.922313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.922313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.922366 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.922535 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.922535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.922536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.922655 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.922713 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.922855 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.922926 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 07:06:10.922974 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.916605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:33287 (local address 127.0.0.1:56118)
0808 07:06:10.916644 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.916653 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.916691 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.916855 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.916855 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.916957 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.917001 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.917002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.917703 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.917704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.918290 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.918292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.918806 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.918807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.918863 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.919204 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.919209 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.920399 (+ 1190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.922020 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.922021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.922021 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.922254 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.922420 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.922420 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.922421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.922473 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.922711 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.922712 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.922754 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.922821 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.922895 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 07:06:10.923614 29961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:10.930130 29965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.923829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45578)
0808 07:06:10.923937 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.923945 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.923989 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.924090 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.924090 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.924195 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.924220 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.924221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.925020 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.925021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.925509 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.925510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.925906 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.925906 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.925952 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.926295 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.926299 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.927495 (+ 1196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.929272 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.929273 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.929273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.929421 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.929627 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.929628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.929628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.929674 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.929868 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.929868 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.929898 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.929946 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.930036 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 07:06:10.930228 29971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.923904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45578 (local address 127.26.23.188:38387)
0808 07:06:10.923940 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.923942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.923978 (+ 36us) server_negotiation.cc:407] Connection header received
0808 07:06:10.924031 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.924032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.924040 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.924086 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.924281 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.924958 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.925584 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.925850 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.925896 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.927595 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.927596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.927596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.927603 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.929201 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.929489 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.929490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.929490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.929548 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.929723 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.929724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.929724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.929829 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.929875 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.929990 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.930083 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":18}
I20260808 07:06:10.931078 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.923924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58636 (local address 127.26.23.190:36895)
0808 07:06:10.923960 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.923962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.923968 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:06:10.923989 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.923989 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.923998 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.924041 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.924583 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.925071 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.925731 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.925914 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.925973 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.928422 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.928423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.928423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.928429 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.929668 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.930124 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.930125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.930126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.930198 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.930611 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.930611 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.930612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.930718 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.930869 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.930908 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.930977 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 07:06:10.931571 29961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: Bootstrap starting.
I20260808 07:06:10.932477 29961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:10.932657 29716 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } attempt: 2
I20260808 07:06:10.932842 29961 log.cc:824] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:10.933694 29961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: No bootstrap required, opened a new log
I20260808 07:06:10.935741 29961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:10.935871 29961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7d61aaa04940299dd26847f406f297, State: Initialized, Role: FOLLOWER
I20260808 07:06:10.935950 29961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:06:10.936261 29961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:10.936239 29975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:10.936463 29975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
W20260808 07:06:10.938177 29992 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:10.938234 29992 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:10.939563 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.932866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45588)
0808 07:06:10.932911 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.932919 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.932951 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.933191 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.933192 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.933334 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.933367 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.933368 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.934041 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.934042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.934739 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.934742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.935059 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.935060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.935114 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.935415 (+ 301us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.935420 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.936895 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.938555 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.938556 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.938556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.938768 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.938957 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.938958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.938958 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.939012 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.939287 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.939287 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.939331 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.939388 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.939475 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 07:06:10.939746 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.931667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.26.23.189:33287)
0808 07:06:10.931708 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.931710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.931778 (+ 68us) server_negotiation.cc:407] Connection header received
0808 07:06:10.931843 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.931844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.931853 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.931904 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.932282 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.932927 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.933731 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.933987 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.934048 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.936528 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.936529 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.936529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.936535 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.938225 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.938683 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.938685 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.938685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.938743 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.938928 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.938929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.938929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.939046 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.939185 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.939579 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.939664 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:06:10.939831 29971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.933010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45588 (local address 127.26.23.188:38387)
0808 07:06:10.933044 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.933045 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.933051 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:06:10.933068 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.933068 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.933076 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.933171 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.933429 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.933977 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.934811 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.935003 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.935053 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.936984 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.936985 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.936985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.936992 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.938476 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.938841 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.938842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.938843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.938898 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.939068 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.939068 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.939069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.939201 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.939261 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.939692 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.939759 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:06:10.941044 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:10.941497 29716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a: Bootstrap starting.
I20260808 07:06:10.938748 29847 master_runner.cc:186] Error getting master registration for 127.26.23.190:36895: OK, instance_id { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" instance_seqno: 1786172770591712 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:06:10.942200 29847 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:06:10.942203 29716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:10.942518 29716 log.cc:824] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:10.942104 29676 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58636
I20260808 07:06:10.943341 29716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a: No bootstrap required, opened a new log
I20260808 07:06:10.944607 29716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:10.944761 29716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d9b4cc7bebd460fab59679edfb7aa3a, State: Initialized, Role: FOLLOWER
I20260808 07:06:10.944839 29716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:10.945179 29716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:10.945155 29997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:10.945216 29676 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 07:06:10.945313 29676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:10.945982 29676 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:10.946189 29997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:10.946247 29676 leader_election.cc:288] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [CANDIDATE]: Term 1 election: Requested vote from peers 93c965944241404ea777425d195400df (127.26.23.189:33287), 3f7d61aaa04940299dd26847f406f297 (127.26.23.188:38387)
I20260808 07:06:10.946645 29920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3f7d61aaa04940299dd26847f406f297"
I20260808 07:06:10.946754 29920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:10.947939 29920 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d9b4cc7bebd460fab59679edfb7aa3a in term 1.
W20260808 07:06:10.947984 30009 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:10.948029 30009 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:10.948251 29645 leader_election.cc:302] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f7d61aaa04940299dd26847f406f297, 9d9b4cc7bebd460fab59679edfb7aa3a; no voters:
I20260808 07:06:10.947922 29603 master_runner.cc:186] Error getting master registration for 127.26.23.189:33287: OK, instance_id { permanent_uuid: "93c965944241404ea777425d195400df" instance_seqno: 1786172770749588 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:06:10.949877 29603 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:06:10.949947 29997 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:10.950114 29997 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [term 1 LEADER]: Becoming Leader. State: Replica: 9d9b4cc7bebd460fab59679edfb7aa3a, State: Running, Role: LEADER
I20260808 07:06:10.950229 29997 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:10.951036 30017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d9b4cc7bebd460fab59679edfb7aa3a. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:10.951182 30017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:10.959571 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.947797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.26.23.189:33287)
0808 07:06:10.947904 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.947906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.950922 (+ 3016us) server_negotiation.cc:407] Connection header received
0808 07:06:10.951067 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.951068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.951079 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.951132 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.952010 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.952746 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.953745 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.954064 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.954131 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.956153 (+ 2022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.956155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.956156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.956174 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.957873 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.958516 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.958518 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.958518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.958581 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.958888 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.958888 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.958889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.959031 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.959118 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.959401 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.959478 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 07:06:10.960732 30023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:10.960950 30023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:10.961745 29971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.950944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45594 (local address 127.26.23.188:38387)
0808 07:06:10.950985 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.950987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.954322 (+ 3335us) server_negotiation.cc:407] Connection header received
0808 07:06:10.954421 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.954422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.954442 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.954488 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.955146 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.955832 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.956802 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.957081 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.957132 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.958598 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.958599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.958600 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.958607 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.960173 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.960536 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.960537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.960538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.960600 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.961176 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.961177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.961177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.961306 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.961382 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.961580 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.961656 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 07:06:10.966354 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.951120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58638 (local address 127.26.23.190:36895)
0808 07:06:10.951154 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.951156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.958286 (+ 7130us) server_negotiation.cc:407] Connection header received
0808 07:06:10.958383 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.958385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.958396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.958424 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.959011 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.959658 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.960614 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.960899 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.960962 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.963366 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.963368 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.963368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.963375 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.964982 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.965505 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.965506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.965506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.965576 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.965779 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.965794 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.965795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.965934 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.966040 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.966186 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.966263 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 07:06:10.975095 29920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [term 1 FOLLOWER]: Refusing update from remote peer 9d9b4cc7bebd460fab59679edfb7aa3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:10.975423 29997 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:10.976840 29975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d9b4cc7bebd460fab59679edfb7aa3a. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:10.976923 29975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:10.978274 29997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:10.978360 29997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:10.978883 29975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:10.978972 29975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:10.979218 30023 catalog_manager.cc:1347] Generated new cluster ID: 652cc1be57794794b92966a1ef91b44b
I20260808 07:06:10.979264 30023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:10.982774 29837 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } attempt: 3
Aug 08 07:06:10 dist-test-slave-zj8q krb5kdc[29584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172770, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
I20260808 07:06:10.990334 29841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.983006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:38387 (local address 127.0.0.1:45600)
0808 07:06:10.983077 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:10.983087 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:10.983121 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:10.983390 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:10.983391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:10.983562 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:10.983606 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.983608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.984434 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.984435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.985200 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:10.985202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.985660 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.985661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:10.985714 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.986138 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:10.986143 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:10.987572 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:10.989304 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.989305 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.989306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.989505 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.989694 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:10.989695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:10.989695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:10.989755 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:10.990015 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:10.990016 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:10.990060 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 07:06:10.990117 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 07:06:10.990237 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 07:06:10.990664 29971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:10.983245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45600 (local address 127.26.23.188:38387)
0808 07:06:10.983281 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:10.983283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:10.983289 (+ 6us) server_negotiation.cc:407] Connection header received
0808 07:06:10.983307 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:10.983307 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:10.983315 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:10.983352 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:10.983673 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.984367 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.985273 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:10.985565 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:10.985611 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:10.987657 (+ 2046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:10.987659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:10.987659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:10.987666 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:10.989219 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.989571 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.989573 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.989573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.989629 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:10.989816 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:10.989817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:10.989818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:10.989940 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:10.989993 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:10.990514 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 07:06:10.990585 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:06:10.992290 29837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: Bootstrap starting.
I20260808 07:06:10.992998 29837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:10.993333 29837 log.cc:824] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:10.994747 30023 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:10.995491 30023 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:11.000105 29837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: No bootstrap required, opened a new log
I20260808 07:06:11.001490 29837 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:11.001605 29837 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93c965944241404ea777425d195400df, State: Initialized, Role: FOLLOWER
I20260808 07:06:11.001680 29837 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } }
I20260808 07:06:11.001936 30032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:11.001998 29837 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:11.002367 29799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "93c965944241404ea777425d195400df"
I20260808 07:06:11.002483 29799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:11.003347 30032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:11.003386 29799 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d9b4cc7bebd460fab59679edfb7aa3a in term 1.
I20260808 07:06:11.003677 29794 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [term 1 FOLLOWER]: Refusing update from remote peer 9d9b4cc7bebd460fab59679edfb7aa3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:11.003957 30017 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:11.006490 30023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a: Generated new TSK 0
I20260808 07:06:11.006659 30023 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 07:06:11.006814 30032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d9b4cc7bebd460fab59679edfb7aa3a. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:11.006886 30032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:11.006917 30032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:11.006951 30032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:06:11.007429 30052 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:11.007478 30052 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:11.008486 30053 mvcc.cc:205] Tried to move back new op lower bound from 7316163670012743680 to 7316163669812830208. Current Snapshot: MvccSnapshot[applied={T|T < 7316163669911400448}]
W20260808 07:06:11.041393 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.040047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56152 (local address 127.26.23.189:33287)
0808 07:06:11.040094 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.040096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.040695 (+ 599us) server_negotiation.cc:407] Connection header received
0808 07:06:11.040798 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.040799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.040811 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.040841 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.041319 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56152: BlockingRecv error: recv got EOF from 127.0.0.1:56152 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 07:06:11.042205 29971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.040409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45612 (local address 127.26.23.188:38387)
0808 07:06:11.040450 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.040452 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.041665 (+ 1213us) server_negotiation.cc:407] Connection header received
0808 07:06:11.041764 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.041766 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.041776 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.041803 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.042100 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45612: BlockingRecv error: recv got EOF from 127.0.0.1:45612 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 07:06:11.043203 29720 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.042564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58644 (local address 127.26.23.190:36895)
0808 07:06:11.042603 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.042605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.042712 (+ 107us) server_negotiation.cc:407] Connection header received
0808 07:06:11.042799 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.042800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.042810 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.042837 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.043139 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58644: BlockingRecv error: recv got EOF from 127.0.0.1:58644 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:06:11.045650 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.044905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56166 (local address 127.26.23.189:33287)
0808 07:06:11.044938 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.044939 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.045097 (+ 158us) server_negotiation.cc:407] Connection header received
0808 07:06:11.045208 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.045209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.045226 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.045254 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.045606 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56166: BlockingRecv error: recv got EOF from 127.0.0.1:56166 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 07:06:11.048504 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.047761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56168 (local address 127.26.23.189:33287)
0808 07:06:11.047793 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.047794 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.048047 (+ 253us) server_negotiation.cc:407] Connection header received
0808 07:06:11.048147 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.048147 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.048158 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.048185 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.048465 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56168: BlockingRecv error: recv got EOF from 127.0.0.1:56168 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 07:06:11.052160 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.051450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56182 (local address 127.26.23.189:33287)
0808 07:06:11.051481 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.051482 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.051699 (+ 217us) server_negotiation.cc:407] Connection header received
0808 07:06:11.051784 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.051784 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.051793 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.051818 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.052108 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56182: BlockingRecv error: recv got EOF from 127.0.0.1:56182 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 07:06:11.057817 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.057084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56188 (local address 127.26.23.189:33287)
0808 07:06:11.057114 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.057116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.057354 (+ 238us) server_negotiation.cc:407] Connection header received
0808 07:06:11.057440 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.057440 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.057449 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.057475 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.057776 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56188: BlockingRecv error: recv got EOF from 127.0.0.1:56188 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 07:06:11.067512 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.066791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56200 (local address 127.26.23.189:33287)
0808 07:06:11.066822 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.066823 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.067045 (+ 222us) server_negotiation.cc:407] Connection header received
0808 07:06:11.067143 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.067144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.067153 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.067181 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.067468 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56200: BlockingRecv error: recv got EOF from 127.0.0.1:56200 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 07:06:11.085620 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.084668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56210 (local address 127.26.23.189:33287)
0808 07:06:11.084708 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.084710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.084989 (+ 279us) server_negotiation.cc:407] Connection header received
0808 07:06:11.085094 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.085095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.085107 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.085150 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.085562 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56210: BlockingRecv error: recv got EOF from 127.0.0.1:56210 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 07:06:11.119971 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.118992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56218 (local address 127.26.23.189:33287)
0808 07:06:11.119047 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.119049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.119389 (+ 340us) server_negotiation.cc:407] Connection header received
0808 07:06:11.119503 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.119504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.119516 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.119546 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.119909 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56218: BlockingRecv error: recv got EOF from 127.0.0.1:56218 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260808 07:06:11.185925 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.185224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56222 (local address 127.26.23.189:33287)
0808 07:06:11.185295 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.185297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.185362 (+ 65us) server_negotiation.cc:407] Connection header received
0808 07:06:11.185439 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.185440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.185451 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.185499 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.185861 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56222: BlockingRecv error: recv got EOF from 127.0.0.1:56222 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 07:06:11.315773 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.315033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56230 (local address 127.26.23.189:33287)
0808 07:06:11.315110 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.315113 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.315228 (+ 115us) server_negotiation.cc:407] Connection header received
0808 07:06:11.315303 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.315304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.315317 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.315371 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.315713 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56230: BlockingRecv error: recv got EOF from 127.0.0.1:56230 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 07:06:11.540107 30017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d9b4cc7bebd460fab59679edfb7aa3a" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 36895 } } peers { permanent_uuid: "93c965944241404ea777425d195400df" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 33287 } } peers { permanent_uuid: "3f7d61aaa04940299dd26847f406f297" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 38387 } } }
I20260808 07:06:11.540264 30017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d9b4cc7bebd460fab59679edfb7aa3a [sys.catalog]: This master's current role is: LEADER
W20260808 07:06:11.573688 29843 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:11.572987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56236 (local address 127.26.23.189:33287)
0808 07:06:11.573048 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:11.573051 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:11.573061 (+ 10us) server_negotiation.cc:407] Connection header received
0808 07:06:11.573123 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:11.573124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:11.573135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:11.573185 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:11.573621 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56236: BlockingRecv error: recv got EOF from 127.0.0.1:56236 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 07:06:11.938664 29992 catalog_manager.cc:1259] Loaded cluster ID: 652cc1be57794794b92966a1ef91b44b
I20260808 07:06:11.938750 29992 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: loading cluster ID for follower catalog manager: success
I20260808 07:06:11.939561 29992 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: acquiring CA information for follower catalog manager: success
I20260808 07:06:11.939872 29992 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3f7d61aaa04940299dd26847f406f297: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:06:12.007900 30052 catalog_manager.cc:1259] Loaded cluster ID: 652cc1be57794794b92966a1ef91b44b
I20260808 07:06:12.007979 30052 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: loading cluster ID for follower catalog manager: success
I20260808 07:06:12.008778 30052 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: acquiring CA information for follower catalog manager: success
I20260808 07:06:12.009075 30052 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 93c965944241404ea777425d195400df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:06:12.089195 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.086821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56244 (local address 127.26.23.189:33287)
0808 07:06:12.086929 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.086931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.086995 (+ 64us) server_negotiation.cc:407] Connection header received
0808 07:06:12.087050 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.087051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.087107 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.087186 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:12.087308 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.087828 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.088539 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.088737 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.088781 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.088920 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:12.089030 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:12.089082 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:12.089110 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 07:06:12.089127 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":60,"threads_started":1}
I20260808 07:06:12.093030 30179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.090995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45622 (local address 127.26.23.188:38387)
0808 07:06:12.091080 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.091081 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.091088 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:06:12.091124 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.091125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.091160 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.091226 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:12.091308 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.091778 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.092445 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.092645 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.092689 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.092782 (+ 93us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:12.092874 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:12.092922 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:12.092937 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 07:06:12.092954 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68,"thread_start_us":42,"threads_started":1}
I20260808 07:06:12.097415 30179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.094707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.26.23.188:38387)
0808 07:06:12.094750 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.094752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.094876 (+ 124us) server_negotiation.cc:407] Connection header received
0808 07:06:12.094931 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.094932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.094942 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.094991 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:12.095077 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.095627 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.096585 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.096858 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.096917 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.097043 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:12.097074 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:12.097114 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:12.097327 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 07:06:12.097348 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 07:06:12.097517 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.094574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56254 (local address 127.26.23.189:33287)
0808 07:06:12.094621 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.094622 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.094699 (+ 77us) server_negotiation.cc:407] Connection header received
0808 07:06:12.094930 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.094931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.094942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.094969 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:12.095125 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.095824 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.096833 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.097110 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.097169 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.097294 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:12.097324 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:12.097372 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:12.097425 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:06:12.097445 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 07:06:12.097819 30188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:12.094547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58658 (local address 127.26.23.190:36895)
0808 07:06:12.094684 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:12.094686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:12.094799 (+ 113us) server_negotiation.cc:407] Connection header received
0808 07:06:12.094889 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:12.094890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:12.094942 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:12.095028 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:12.095189 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.095946 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.096679 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:12.096931 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:12.096990 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:12.097137 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:12.097247 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:12.097300 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:12.097458 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 07:06:12.097735 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":48,"threads_started":1}
I20260808 07:06:12.099399 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29603
I20260808 07:06:12.117619 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29726
I20260808 07:06:12.130024 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 29847
2026-08-08T07:06:12Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2906 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 07:06:12 dist-test-slave-zj8q krb5kdc[30193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 07:06:12 dist-test-slave-zj8q krb5kdc[30193](info): set up 2 sockets
Aug 08 07:06:12 dist-test-slave-zj8q krb5kdc[30193](info): commencing operation
krb5kdc: starting...
W20260808 07:06:13.267040 26718 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/test-user.keytab.
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T07:06:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T07:06:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.26.23.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
Entry for principal kudu/127.26.23.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab.
I20260808 07:06:13.382684 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46711
--webserver_interface=127.26.23.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:46711,127.26.23.189:39325,127.26.23.188:40769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 07:06:13.462316 30213 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:06:13.462515 30213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:13.462539 30213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:13.462564 30213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:13.463660 30213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:13.463699 30213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:13.463725 30213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:13.463740 30213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:13.463757 30213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:13.465224 30213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:46711,127.26.23.189:39325,127.26.23.188:40769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.190.keytab
--principal=kudu/127.26.23.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.190:46711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.23.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:13.465461 30213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:13.465673 30213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:13.470275 30219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:13.470387 30213 server_base.cc:1034] running on GCE node
W20260808 07:06:13.470259 30225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:13.470253 30228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:13.470757 30213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:13.471026 30213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:13.472178 30213 hybrid_clock.cc:648] HybridClock initialized: now 1786172773472165 us; error 30 us; skew 500 ppm
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:13.477726 30213 init.cc:377] Logged in from keytab as kudu/127.26.23.190@KRBTEST.COM (short username kudu)
I20260808 07:06:13.478120 30213 webserver.cc:460] Webserver started at http://127.26.23.190:35315/ using document root <none> and password file <none>
I20260808 07:06:13.478340 30213 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:13.478385 30213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:13.478502 30213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:13.479519 30213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data/instance:
uuid: "b55be5c4894342979b322cfd52754fad"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "a8c821ac3b845f8c7a49d1c7b6e6f341"
server_key_iv: "87c84116c8b07a14f236ad7a917cd8fb"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.479856 30213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal/instance:
uuid: "b55be5c4894342979b322cfd52754fad"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "a8c821ac3b845f8c7a49d1c7b6e6f341"
server_key_iv: "87c84116c8b07a14f236ad7a917cd8fb"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.481057 30213 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:13.481670 30241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:13.481808 30213 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 07:06:13.481895 30213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal
uuid: "b55be5c4894342979b322cfd52754fad"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "a8c821ac3b845f8c7a49d1c7b6e6f341"
server_key_iv: "87c84116c8b07a14f236ad7a917cd8fb"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.481957 30213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:13.505362 30213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:13.507200 30213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:13.507330 30213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:13.511090 30213 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.190:46711
I20260808 07:06:13.511132 30327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.190:46711 every 8 connection(s)
I20260808 07:06:13.511447 30213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/data/info.pb
I20260808 07:06:13.512388 30328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:13.513913 30328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:13.517462 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30213
I20260808 07:06:13.517560 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-0/wal/instance
I20260808 07:06:13.517814 26718 external_mini_cluster.cc:1428] Setting key 82e20b8611ae75a65063fbed9cccd96b
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:13.523155 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.514704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.26.23.190:46711)
0808 07:06:13.514821 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.514826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.514855 (+ 29us) server_negotiation.cc:407] Connection header received
0808 07:06:13.515344 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.515346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.515362 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.515434 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.515933 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.516724 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.517613 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.518088 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.518223 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.520252 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.520259 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.520259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.520266 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.521688 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.522027 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.522030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.522031 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.522112 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.522327 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.522328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.522328 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.522532 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.522600 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.522796 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.522976 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":88,"thread_start_us":44,"threads_started":1}
I20260808 07:06:13.523154 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.514534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:46711 (local address 127.0.0.1:55894)
0808 07:06:13.514727 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.514764 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.515227 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.515452 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.515454 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.515705 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.515860 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.515864 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.516793 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.516794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.517509 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.517511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.518229 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.518230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.518287 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.518770 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.518779 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.520175 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.521766 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.521772 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.521774 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.521957 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.522184 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.522185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.522185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.522274 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.522592 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.522598 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.522670 (+ 72us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.522748 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.522912 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260808 07:06:13.523837 30328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:13.524147 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.524046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37108)
0808 07:06:13.524086 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.524127 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:06:13.524272 30248 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
I20260808 07:06:13.524678 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.524573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37114)
0808 07:06:13.524620 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.524660 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 07:06:13.524813 30328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:39325: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.26.23.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab.
Entry for principal kudu/127.26.23.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab.
I20260808 07:06:13.542479 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:39325
--webserver_interface=127.26.23.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab
--principal=kudu/127.26.23.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:46711,127.26.23.189:39325,127.26.23.188:40769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:06:13.574029 30328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } attempt: 1
I20260808 07:06:13.574553 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.574423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37126)
0808 07:06:13.574484 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.574517 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 07:06:13.574975 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.574899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37136)
0808 07:06:13.574932 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.574958 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:06:13.575062 30328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:39325: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
W20260808 07:06:13.624104 30336 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:06:13.624320 30336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:13.624336 30336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:13.624354 30336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 07:06:13.625432 30336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:13.625464 30336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:13.625476 30336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:13.625488 30336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:13.625499 30336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:13.627094 30336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:46711,127.26.23.189:39325,127.26.23.188:40769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.189.keytab
--principal=kudu/127.26.23.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.189:39325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.26.23.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:13.627298 30336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:13.627472 30336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:13.632118 30346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:13.632148 30349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:13.632146 30347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:13.632236 30336 server_base.cc:1034] running on GCE node
I20260808 07:06:13.632580 30336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:13.632884 30336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:13.634049 30336 hybrid_clock.cc:648] HybridClock initialized: now 1786172773634034 us; error 29 us; skew 500 ppm
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:13.636574 30336 init.cc:377] Logged in from keytab as kudu/127.26.23.189@KRBTEST.COM (short username kudu)
I20260808 07:06:13.636958 30336 webserver.cc:460] Webserver started at http://127.26.23.189:37653/ using document root <none> and password file <none>
I20260808 07:06:13.637168 30336 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:13.637212 30336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:13.637300 30336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:13.638321 30336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data/instance:
uuid: "aeda6efb5d9a468499ee0eab87276fa1"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "6506cbcc89274379ee264c6bee9dd8eb"
server_key_iv: "fff4ad5048b7af849931896c13854411"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.638615 30336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal/instance:
uuid: "aeda6efb5d9a468499ee0eab87276fa1"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "6506cbcc89274379ee264c6bee9dd8eb"
server_key_iv: "fff4ad5048b7af849931896c13854411"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.639801 30336 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 07:06:13.640475 30360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:13.640632 30336 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 07:06:13.640722 30336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal
uuid: "aeda6efb5d9a468499ee0eab87276fa1"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "6506cbcc89274379ee264c6bee9dd8eb"
server_key_iv: "fff4ad5048b7af849931896c13854411"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.640790 30336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:13.643211 30328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } attempt: 2
I20260808 07:06:13.643635 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.643438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37148)
0808 07:06:13.643500 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.643593 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 07:06:13.643978 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.643882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37162)
0808 07:06:13.643920 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.643951 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 07:06:13.644084 30328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.189:39325: Network error: Client connection negotiation failed: client connection to 127.26.23.189:39325: connect: Connection refused (error 111)
I20260808 07:06:13.655270 30336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:13.656800 30336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:13.656908 30336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:13.660604 30336 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.189:39325
I20260808 07:06:13.660646 30434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.189:39325 every 8 connection(s)
I20260808 07:06:13.660929 30336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/data/info.pb
I20260808 07:06:13.661842 30435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:13.663326 30435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:13.667470 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30336
I20260808 07:06:13.667574 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-1/wal/instance
I20260808 07:06:13.667779 26718 external_mini_cluster.cc:1428] Setting key 4f2ce1e6a30d6953c40c6641c4b7f2c1
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:13.671702 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.663941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.26.23.190:46711)
0808 07:06:13.663995 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.663997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.664194 (+ 197us) server_negotiation.cc:407] Connection header received
0808 07:06:13.664678 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.664679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.664693 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.664753 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.665312 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.665809 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.666789 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.666987 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.667040 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.668988 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.668990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.668991 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.668998 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.670402 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.670833 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.670834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.670835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.670890 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.671141 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.671141 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.671141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.671237 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.671283 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.671556 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.671620 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:06:13.671908 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.663923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:46711 (local address 127.0.0.1:55910)
0808 07:06:13.664079 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.664110 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.664555 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.664814 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.664816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.665041 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.665245 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.665250 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.665885 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.665886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.666711 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.666715 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.667071 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.667072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.667175 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.667601 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.667611 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.668903 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.670477 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.670483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.670485 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.670766 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.670946 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.670946 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.670947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.671073 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.671287 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.671293 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.671440 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.671545 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.671691 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260808 07:06:13.672469 30435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.26.23.188@KRBTEST.COM; defaulting to no policy
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.26.23.188@KRBTEST.COM" created.
I20260808 07:06:13.679442 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.672703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37166)
0808 07:06:13.672748 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.672759 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.672802 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.672998 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.672999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.673147 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.673203 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.673205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.674000 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.674001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.674823 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.674827 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.675269 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.675270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.675345 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.675652 (+ 307us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.675657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.676841 (+ 1184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.678485 (+ 1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.678486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.678487 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.678642 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.678826 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.678827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.678827 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.678880 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.679146 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.679147 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.679185 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.679243 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.679340 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 07:06:13.679510 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.672739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37166 (local address 127.26.23.189:39325)
0808 07:06:13.672870 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.672874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.672891 (+ 17us) server_negotiation.cc:407] Connection header received
0808 07:06:13.672911 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.672912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.672923 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.672981 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.673266 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.673920 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.674900 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.675197 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.675251 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.676921 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.676928 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.676928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.676934 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.678418 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.678711 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.678714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.678714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.678763 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.678931 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.678932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.678932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.679061 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.679130 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.679279 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.679391 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260808 07:06:13.680254 30435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:13.680665 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.680482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34594)
0808 07:06:13.680582 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.680637 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 07:06:13.680811 30364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
I20260808 07:06:13.681182 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.681092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34598)
0808 07:06:13.681133 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.681162 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 07:06:13.681283 30435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:40769: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.26.23.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab.
Entry for principal kudu/127.26.23.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab.
I20260808 07:06:13.692889 26718 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
/tmp/dist-test-taskGJ9A1U/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:40769
--webserver_interface=127.26.23.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab
--principal=kudu/127.26.23.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.26.23.148:42461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.23.190:46711,127.26.23.189:39325,127.26.23.188:40769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 07:06:13.730511 30435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } attempt: 1
I20260808 07:06:13.730980 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.730856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34608)
0808 07:06:13.730915 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.730949 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 07:06:13.731300 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.731217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34618)
0808 07:06:13.731253 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.731276 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:06:13.731386 30435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:40769: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
I20260808 07:06:13.735256 30328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } attempt: 3
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:06:13.741569 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.735644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.26.23.189:39325)
0808 07:06:13.735705 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.735706 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.735718 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:06:13.735756 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.735757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.735769 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.735813 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.736153 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.736688 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.737381 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.737591 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.737648 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.739367 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.739368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.739369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.739376 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.740585 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.740884 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.740886 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.740886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.740936 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.741094 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.741095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.741095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.741211 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.741267 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.741404 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.741475 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 07:06:13.741571 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.735552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37170)
0808 07:06:13.735611 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.735621 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.735694 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.735824 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.735825 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.735994 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.736068 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.736070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.736763 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.736764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.737289 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.737291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.737661 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.737661 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.737736 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.738132 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.738136 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.739291 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.740663 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.740664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.740665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.740825 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.740989 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.740989 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.740990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.741046 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.741267 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.741268 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.741316 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.741375 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.741475 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 07:06:13.742064 30328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:13.742409 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.742313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34624)
0808 07:06:13.742354 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.742380 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 07:06:13.742674 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.742595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34634)
0808 07:06:13.742629 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.742652 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 07:06:13.742755 30328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:40769: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
I20260808 07:06:13.773926 30328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } attempt: 1
W20260808 07:06:13.773823 30446 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 07:06:13.774065 30446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 07:06:13.774091 30446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 07:06:13.774115 30446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 07:06:13.774471 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.774323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34640)
0808 07:06:13.774389 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.774434 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 07:06:13.774857 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.774760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34652)
0808 07:06:13.774804 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.774835 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 07:06:13.774957 30328 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:40769: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
W20260808 07:06:13.775504 30446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 07:06:13.775549 30446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 07:06:13.775563 30446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 07:06:13.775574 30446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 07:06:13.775590 30446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 07:06:13.777037 30446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.23.148:42461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.26.23.190:46711,127.26.23.189:39325,127.26.23.188:40769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/krb5kdc/kudu_127.26.23.188.keytab
--principal=kudu/127.26.23.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.23.188:40769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.26.23.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 06:08:33 UTC on ccycloud.quasar-fdzluz.root.comops.site
build id 4574265
I20260808 07:06:13.777220 30446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 07:06:13.777405 30446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 07:06:13.781957 30456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 07:06:13.781926 30458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:13.782101 30446 server_base.cc:1034] running on GCE node
W20260808 07:06:13.781939 30455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 07:06:13.782387 30446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 07:06:13.782667 30446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 07:06:13.783814 30446 hybrid_clock.cc:648] HybridClock initialized: now 1786172773783793 us; error 32 us; skew 500 ppm
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 07:06:13.786362 30446 init.cc:377] Logged in from keytab as kudu/127.26.23.188@KRBTEST.COM (short username kudu)
I20260808 07:06:13.786845 30446 webserver.cc:460] Webserver started at http://127.26.23.188:37911/ using document root <none> and password file <none>
I20260808 07:06:13.787072 30446 fs_manager.cc:359] Metadata directory not provided
I20260808 07:06:13.787118 30446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 07:06:13.787243 30446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 07:06:13.788297 30446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data/instance:
uuid: "6f8c4a94a96845d896f6fe4cb385340e"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "e6dda147d8822942c755443b1fa58143"
server_key_iv: "04d15ff51e23a0292ef09fc27e0d880b"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.788640 30446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal/instance:
uuid: "6f8c4a94a96845d896f6fe4cb385340e"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "e6dda147d8822942c755443b1fa58143"
server_key_iv: "04d15ff51e23a0292ef09fc27e0d880b"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.789861 30446 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 07:06:13.790585 30473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:13.790735 30446 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 07:06:13.790817 30446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data,/tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal
uuid: "6f8c4a94a96845d896f6fe4cb385340e"
format_stamp: "Formatted at 2026-08-08 07:06:13 on dist-test-slave-zj8q"
server_key: "e6dda147d8822942c755443b1fa58143"
server_key_iv: "04d15ff51e23a0292ef09fc27e0d880b"
server_key_version: "encryptionkey@0"
I20260808 07:06:13.790885 30446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 07:06:13.799522 30435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } attempt: 2
I20260808 07:06:13.799892 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.799783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34656)
0808 07:06:13.799835 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.799862 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 07:06:13.800197 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.800101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34668)
0808 07:06:13.800155 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.800178 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 07:06:13.800287 30435 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.26.23.188:40769: Network error: Client connection negotiation failed: client connection to 127.26.23.188:40769: connect: Connection refused (error 111)
I20260808 07:06:13.800582 30446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 07:06:13.802340 30446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 07:06:13.802470 30446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 07:06:13.806324 30446 rpc_server.cc:307] RPC server started. Bound to: 127.26.23.188:40769
I20260808 07:06:13.806365 30548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.23.188:40769 every 8 connection(s)
I20260808 07:06:13.806704 30446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/data/info.pb
I20260808 07:06:13.807331 26718 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu as pid 30446
I20260808 07:06:13.807451 26718 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGJ9A1U/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786172503363962-26718-0/minicluster-data/master-2/wal/instance
I20260808 07:06:13.807667 26718 external_mini_cluster.cc:1428] Setting key ccf78b6df2a80368ed7f6e11358fab69
I20260808 07:06:13.807855 30550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 07:06:13.810179 30550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:13.817294 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.810808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.26.23.190:46711)
0808 07:06:13.810868 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.810871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.811026 (+ 155us) server_negotiation.cc:407] Connection header received
0808 07:06:13.811087 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.811088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.811098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.811152 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.811562 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.812012 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.812847 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.813034 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.813088 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.815012 (+ 1924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.815013 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.815014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.815020 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.816283 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.816593 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.816594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.816595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.816649 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.816806 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.816807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.816807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.816912 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.816967 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.817133 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.817201 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 07:06:13.817329 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.808176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34674 (local address 127.26.23.188:40769)
0808 07:06:13.808356 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.808365 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.808390 (+ 25us) server_negotiation.cc:407] Connection header received
0808 07:06:13.808938 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.808945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.808991 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.809098 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.809848 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.810868 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.811594 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.812003 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.812095 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.814345 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.814353 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.814353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.814360 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.815927 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.816279 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.816281 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.816282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.816355 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.816539 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.816539 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.816540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.816756 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.816889 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.816989 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.817115 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":78,"threads_started":1}
I20260808 07:06:13.817334 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.810746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.190:46711 (local address 127.0.0.1:55916)
0808 07:06:13.810929 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.810965 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.811029 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.811171 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.811174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.811419 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.811486 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.811488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.812087 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.812088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.812771 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.812774 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.813126 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.813128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.813186 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.813561 (+ 375us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.813569 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.814937 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.816335 (+ 1398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.816343 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.816345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.816528 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.816701 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.816702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.816702 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.816758 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.816966 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.816973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.817022 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.817094 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.817201 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
I20260808 07:06:13.817848 30550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.190@KRBTEST.COM
I20260808 07:06:13.824420 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.818185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37180 (local address 127.26.23.189:39325)
0808 07:06:13.818223 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.818225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.818233 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:13.818256 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.818257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.818266 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.818324 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.818592 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.819205 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.820007 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.820203 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.820257 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.821990 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.821992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.821992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.822000 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.823392 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.823749 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.823750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.823750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.823802 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.823973 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.823974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.823974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.824065 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.824118 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.824267 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.824331 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:06:13.824420 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.818051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.189:39325 (local address 127.0.0.1:37180)
0808 07:06:13.818079 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.818089 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.818171 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.818332 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.818333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.818473 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.818526 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.818528 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.819277 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.819277 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.819927 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.819929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.820262 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.820263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.820316 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.820684 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.820688 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.821911 (+ 1223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.823476 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.823477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.823478 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.823682 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.823858 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.823859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.823860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.823922 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.824130 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.824131 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.824173 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.824236 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.824325 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260808 07:06:13.824788 30550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } has no permanent_uuid. Determining permanent_uuid...
I20260808 07:06:13.825186 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.818081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55924 (local address 127.26.23.190:46711)
0808 07:06:13.818112 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.818114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.818220 (+ 106us) server_negotiation.cc:407] Connection header received
0808 07:06:13.818300 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.818301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.818310 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.818357 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.818826 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.819427 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.820246 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.820447 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.820492 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.822542 (+ 2050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.822543 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.822543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.822550 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.824048 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.824333 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.824334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.824335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.824388 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.824580 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.824581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.824582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.824711 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.824834 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.825027 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.825093 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.188@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.26.23.189@KRBTEST.COM
I20260808 07:06:13.831243 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.825003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34688)
0808 07:06:13.825066 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.825075 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.825115 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.825303 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.825304 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.825439 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.825465 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.825466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.826352 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.826353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.826798 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.826799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.827137 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.827138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.827183 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.827495 (+ 312us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.827499 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.828705 (+ 1206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.830085 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.830086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.830086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.830301 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.830514 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.830515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.830516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.830571 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.830831 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.830832 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.830905 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.831013 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.831116 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 07:06:13.831245 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.825041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34688 (local address 127.26.23.188:40769)
0808 07:06:13.825069 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.825071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.825103 (+ 32us) server_negotiation.cc:407] Connection header received
0808 07:06:13.825221 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.825221 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.825229 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.825272 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.825535 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.826285 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.826870 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.827075 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.827126 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.828821 (+ 1695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.828822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.828822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.828828 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.830006 (+ 1178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.830368 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.830369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.830370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.830432 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.830655 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.830656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.830657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.830769 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.830820 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.831035 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.831162 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":16}
I20260808 07:06:13.832319 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.825784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37194 (local address 127.26.23.189:39325)
0808 07:06:13.825816 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.825817 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.825825 (+ 8us) server_negotiation.cc:407] Connection header received
0808 07:06:13.825863 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.825863 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.825870 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.825909 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.826417 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.826847 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.827432 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.827630 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.827681 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.829789 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.829790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.829791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.829797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.831303 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.831640 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.831641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.831641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.831697 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.831880 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.831881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.831882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.831984 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.832136 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.832171 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.832236 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 07:06:13.832679 30550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: Bootstrap starting.
I20260808 07:06:13.833563 30550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:13.833598 26718 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 07:06:13.833860 30550 log.cc:824] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:13.834614 30550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: No bootstrap required, opened a new log
I20260808 07:06:13.834759 30285 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b55be5c4894342979b322cfd52754fad"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55924
I20260808 07:06:13.836021 30550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.836148 30550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f8c4a94a96845d896f6fe4cb385340e, State: Initialized, Role: FOLLOWER
I20260808 07:06:13.836225 30550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.836493 30559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.836541 30550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:13.836587 30559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: This master's current role is: FOLLOWER
W20260808 07:06:13.838310 30574 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:13.838362 30574 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:13.838603 30446 master_runner.cc:186] Error getting master registration for 127.26.23.190:46711: OK, instance_id { permanent_uuid: "b55be5c4894342979b322cfd52754fad" instance_seqno: 1786172773509998 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:06:13.840538 30446 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:06:13.850095 30328 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } attempt: 2
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.190@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
I20260808 07:06:13.857432 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.850539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34700 (local address 127.26.23.188:40769)
0808 07:06:13.850585 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.850587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.850598 (+ 11us) server_negotiation.cc:407] Connection header received
0808 07:06:13.850621 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.850622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.850632 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.850687 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.850993 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.851439 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.852469 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.852751 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.852811 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.854791 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.854793 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.854793 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.854800 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.856293 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.856671 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.856672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.856672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.856726 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.856899 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.856899 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.856900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.857054 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.857121 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.857263 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.857339 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 07:06:13.857432 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.850387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34700)
0808 07:06:13.850442 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.850453 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.850491 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.850694 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.850695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.850881 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.850931 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.850933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.851538 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.851539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.852373 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.852377 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.852808 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.852809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.852887 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.853276 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.853281 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.854712 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.856374 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.856375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.856375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.856596 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.856782 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.856782 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.856783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.856847 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.857119 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.857120 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.857168 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.857237 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.857333 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 07:06:13.859025 30328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad: Bootstrap starting.
I20260808 07:06:13.859647 30328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:13.859917 30328 log.cc:824] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:13.860632 30328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad: No bootstrap required, opened a new log
I20260808 07:06:13.861598 30328 raft_consensus.cc:348] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.861711 30328 raft_consensus.cc:729] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b55be5c4894342979b322cfd52754fad, State: Initialized, Role: FOLLOWER
I20260808 07:06:13.861783 30328 consensus_queue.cc:260] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.862035 30581 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.862097 30328 sys_catalog.cc:564] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:13.862183 30285 raft_consensus.cc:482] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 07:06:13.862205 30581 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:13.862310 30285 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:13.863086 30285 raft_consensus.cc:504] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.863323 30285 leader_election.cc:288] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [CANDIDATE]: Term 1 election: Requested vote from peers aeda6efb5d9a468499ee0eab87276fa1 (127.26.23.189:39325), 6f8c4a94a96845d896f6fe4cb385340e (127.26.23.188:40769)
I20260808 07:06:13.863718 30515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b55be5c4894342979b322cfd52754fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6f8c4a94a96845d896f6fe4cb385340e"
I20260808 07:06:13.863852 30515 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:13.864817 30515 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b55be5c4894342979b322cfd52754fad in term 1.
I20260808 07:06:13.865039 30248 leader_election.cc:302] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f8c4a94a96845d896f6fe4cb385340e, b55be5c4894342979b322cfd52754fad; no voters:
I20260808 07:06:13.865243 30581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 07:06:13.865389 30581 raft_consensus.cc:686] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [term 1 LEADER]: Becoming Leader. State: Replica: b55be5c4894342979b322cfd52754fad, State: Running, Role: LEADER
I20260808 07:06:13.865481 30581 consensus_queue.cc:237] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
W20260808 07:06:13.867969 30607 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 07:06:13.868029 30607 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:13.867056 30213 master_runner.cc:186] Error getting master registration for 127.26.23.189:39325: OK, instance_id { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" instance_seqno: 1786172773659630 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 07:06:13.869220 30213 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 07:06:13.869477 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55be5c4894342979b322cfd52754fad. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.869578 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:13.873265 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.864529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55932 (local address 127.26.23.190:46711)
0808 07:06:13.864584 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.864586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.864685 (+ 99us) server_negotiation.cc:407] Connection header received
0808 07:06:13.864755 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.864756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.864766 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.864835 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.865515 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.866222 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.867173 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.867472 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.867531 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.869937 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.869938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.869939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.869946 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.871643 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.872210 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.872211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.872211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.872281 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.872574 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.872576 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.872576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.872720 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.872788 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.873099 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.873176 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 07:06:13.880710 30441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.869894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37204 (local address 127.26.23.189:39325)
0808 07:06:13.869935 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.869936 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.870413 (+ 477us) server_negotiation.cc:407] Connection header received
0808 07:06:13.870501 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.870502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.870514 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.870545 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.871139 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.871843 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.873620 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.874544 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.874591 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.877516 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.877517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.877517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.877525 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.879379 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.879778 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.879779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.879779 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.879838 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.880128 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.880129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.880130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.880264 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.880333 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.880535 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.880615 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:06:13.884541 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.870103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34716 (local address 127.26.23.188:40769)
0808 07:06:13.870138 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.870140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.872892 (+ 2752us) server_negotiation.cc:407] Connection header received
0808 07:06:13.872980 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.872981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.872990 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.873017 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.874914 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.875603 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.877808 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.878109 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.878170 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.881686 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.881687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.881688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.881695 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.883248 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.883626 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.883627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.883627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.883707 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.883926 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.883926 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.883927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.884070 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.884174 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.884360 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.884448 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 07:06:13.886260 30609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 07:06:13.886487 30609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 07:06:13.887905 30515 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [term 1 FOLLOWER]: Refusing update from remote peer b55be5c4894342979b322cfd52754fad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:13.888209 30605 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:13.889740 30559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55be5c4894342979b322cfd52754fad. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.889839 30559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:13.891351 30435 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } attempt: 3
Aug 08 07:06:13 dist-test-slave-zj8q krb5kdc[30193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786172773, etypes {rep=17 tkt=17 ses=17}, kudu/127.26.23.189@KRBTEST.COM for kudu/127.26.23.188@KRBTEST.COM
I20260808 07:06:13.898787 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.898880 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:13.899647 30559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.899726 30559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:13.899755 30609 catalog_manager.cc:1347] Generated new cluster ID: a59b9629b62546c7bc0eca307c8a9657
I20260808 07:06:13.899797 30609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 07:06:13.900318 30613 mvcc.cc:205] Tried to move back new op lower bound from 7316163681842794496 to 7316163681753763840. Current Snapshot: MvccSnapshot[applied={T|T < 7316163681842794496 or (T in {7316163681842794496})}]
I20260808 07:06:13.902348 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.893205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.26.23.188:40769 (local address 127.0.0.1:34732)
0808 07:06:13.893249 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 07:06:13.893261 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 07:06:13.893308 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 07:06:13.893468 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 07:06:13.893469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 07:06:13.893646 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 07:06:13.893691 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.893693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.894773 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.894774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.895581 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 07:06:13.895583 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.896513 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.896514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 07:06:13.896586 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.896982 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 07:06:13.896987 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 07:06:13.898540 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 07:06:13.901182 (+ 2642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.901183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.901183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.901384 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.901615 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 07:06:13.901616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 07:06:13.901616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 07:06:13.901689 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 07:06:13.901994 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 07:06:13.901995 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 07:06:13.902052 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 07:06:13.902120 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 07:06:13.902247 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 07:06:13.902875 30553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:13.893289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34732 (local address 127.26.23.188:40769)
0808 07:06:13.893319 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.893320 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.893329 (+ 9us) server_negotiation.cc:407] Connection header received
0808 07:06:13.893362 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.893362 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.893371 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.893413 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.893781 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.894595 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.896109 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:13.896396 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:13.896449 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:13.898958 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 07:06:13.898960 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 07:06:13.898960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 07:06:13.898967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 07:06:13.901091 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.901471 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.901472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.901472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.901540 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 07:06:13.901762 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 07:06:13.901763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 07:06:13.901764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 07:06:13.901900 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 07:06:13.901956 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:13.902716 (+ 760us) server_negotiation.cc:299] Negotiation successful
0808 07:06:13.902791 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 07:06:13.904306 30435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: Bootstrap starting.
I20260808 07:06:13.905005 30435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: Neither blocks nor log segments found. Creating new log.
I20260808 07:06:13.905318 30435 log.cc:824] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: Log is configured to *not* fsync() on all Append() calls
I20260808 07:06:13.905628 30615 mvcc.cc:205] Tried to move back new op lower bound from 7316163681842794496 to 7316163681753763840. Current Snapshot: MvccSnapshot[applied={T|T < 7316163681842794496}]
I20260808 07:06:13.910790 30435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: No bootstrap required, opened a new log
I20260808 07:06:13.912909 30435 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.913051 30435 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeda6efb5d9a468499ee0eab87276fa1, State: Initialized, Role: FOLLOWER
I20260808 07:06:13.913134 30435 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } }
I20260808 07:06:13.913456 30435 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 07:06:13.913436 30628 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.913754 30628 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:13.913530 30397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 07:06:13.915467 30397 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [term 1 FOLLOWER]: Refusing update from remote peer b55be5c4894342979b322cfd52754fad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 07:06:13.913554 30400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b55be5c4894342979b322cfd52754fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "aeda6efb5d9a468499ee0eab87276fa1"
I20260808 07:06:13.915782 30581 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 07:06:13.916402 30400 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b55be5c4894342979b322cfd52754fad in term 1.
I20260808 07:06:13.918406 30628 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b55be5c4894342979b322cfd52754fad. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.919063 30628 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:13.919113 30628 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.919162 30628 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 07:06:13.921952 30643 mvcc.cc:205] Tried to move back new op lower bound from 7316163681842794496 to 7316163681753763840. Current Snapshot: MvccSnapshot[applied={T|T < 7316163681842794496}]
I20260808 07:06:13.926445 30641 catalog_manager.cc:1259] Loaded cluster ID: a59b9629b62546c7bc0eca307c8a9657
I20260808 07:06:13.926532 30641 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: loading cluster ID for follower catalog manager: success
W20260808 07:06:13.926669 30641 catalog_manager.cc:1576] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260808 07:06:13.926760 30641 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260808 07:06:13.928771 30581 sys_catalog.cc:455] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b55be5c4894342979b322cfd52754fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b55be5c4894342979b322cfd52754fad" member_type: VOTER last_known_addr { host: "127.26.23.190" port: 46711 } } peers { permanent_uuid: "aeda6efb5d9a468499ee0eab87276fa1" member_type: VOTER last_known_addr { host: "127.26.23.189" port: 39325 } } peers { permanent_uuid: "6f8c4a94a96845d896f6fe4cb385340e" member_type: VOTER last_known_addr { host: "127.26.23.188" port: 40769 } } }
I20260808 07:06:13.928871 30581 sys_catalog.cc:458] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad [sys.catalog]: This master's current role is: LEADER
I20260808 07:06:13.931281 30609 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 07:06:13.932037 30609 catalog_manager.cc:1504] Loading token signing keys...
I20260808 07:06:13.941965 30609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b55be5c4894342979b322cfd52754fad: Generated new TSK 0
I20260808 07:06:13.942168 30609 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 07:06:13.971544 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.969801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.26.23.189:39325)
0808 07:06:13.969845 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.969847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.970866 (+ 1019us) server_negotiation.cc:407] Connection header received
0808 07:06:13.970962 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.970963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.970975 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.971004 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.971456 (+ 452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37218: BlockingRecv error: recv got EOF from 127.0.0.1:37218 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:06:13.972298 30553 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.970222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34738 (local address 127.26.23.188:40769)
0808 07:06:13.970267 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.970269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.971788 (+ 1519us) server_negotiation.cc:407] Connection header received
0808 07:06:13.971881 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.971882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.971892 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.971919 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.972237 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34738: BlockingRecv error: recv got EOF from 127.0.0.1:34738 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:06:13.973014 30331 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.970584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55948 (local address 127.26.23.190:46711)
0808 07:06:13.970624 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.970626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.972531 (+ 1905us) server_negotiation.cc:407] Connection header received
0808 07:06:13.972627 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.972629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.972639 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.972665 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.972956 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55948: BlockingRecv error: recv got EOF from 127.0.0.1:55948 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 07:06:13.975335 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.974140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37228 (local address 127.26.23.189:39325)
0808 07:06:13.974191 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.974193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.974802 (+ 609us) server_negotiation.cc:407] Connection header received
0808 07:06:13.974931 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.974932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.974950 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.974976 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.975291 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37228: BlockingRecv error: recv got EOF from 127.0.0.1:37228 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 07:06:13.978374 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.977556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.26.23.189:39325)
0808 07:06:13.977590 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.977592 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.977836 (+ 244us) server_negotiation.cc:407] Connection header received
0808 07:06:13.977930 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.977931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.977942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.977970 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.978317 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37240: BlockingRecv error: recv got EOF from 127.0.0.1:37240 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:06:13.982529 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.981703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37250 (local address 127.26.23.189:39325)
0808 07:06:13.981735 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.981737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.981994 (+ 257us) server_negotiation.cc:407] Connection header received
0808 07:06:13.982082 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.982084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.982094 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.982120 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.982475 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37250: BlockingRecv error: recv got EOF from 127.0.0.1:37250 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 07:06:13.988409 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.987655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.26.23.189:39325)
0808 07:06:13.987688 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.987690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.987926 (+ 236us) server_negotiation.cc:407] Connection header received
0808 07:06:13.988012 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.988013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.988023 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.988050 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.988363 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37252: BlockingRecv error: recv got EOF from 127.0.0.1:37252 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 07:06:13.998442 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:13.997591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.26.23.189:39325)
0808 07:06:13.997629 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:13.997631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:13.997895 (+ 264us) server_negotiation.cc:407] Connection header received
0808 07:06:13.997986 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:13.997987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:13.997998 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:13.998025 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:13.998385 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37254: BlockingRecv error: recv got EOF from 127.0.0.1:37254 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 07:06:14.018369 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.016951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37270 (local address 127.26.23.189:39325)
0808 07:06:14.016994 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.016997 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.017586 (+ 589us) server_negotiation.cc:407] Connection header received
0808 07:06:14.017805 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.017807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.017822 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.017851 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.018308 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37270: BlockingRecv error: recv got EOF from 127.0.0.1:37270 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 07:06:14.052517 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.051803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.26.23.189:39325)
0808 07:06:14.051849 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.051851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.051992 (+ 141us) server_negotiation.cc:407] Connection header received
0808 07:06:14.052051 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.052051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.052064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.052114 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.052451 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37276: BlockingRecv error: recv got EOF from 127.0.0.1:37276 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 07:06:14.118364 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.117611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37292 (local address 127.26.23.189:39325)
0808 07:06:14.117681 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.117684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.117801 (+ 117us) server_negotiation.cc:407] Connection header received
0808 07:06:14.117870 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.117871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.117884 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.117934 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.118299 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37292: BlockingRecv error: recv got EOF from 127.0.0.1:37292 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 07:06:14.248126 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.247490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.26.23.189:39325)
0808 07:06:14.247551 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.247553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.247650 (+ 97us) server_negotiation.cc:407] Connection header received
0808 07:06:14.247704 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.247705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.247717 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.247780 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.248069 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37304: BlockingRecv error: recv got EOF from 127.0.0.1:37304 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 07:06:14.506032 30441 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 07:06:14.505326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37316 (local address 127.26.23.189:39325)
0808 07:06:14.505395 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:14.505397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:14.505409 (+ 12us) server_negotiation.cc:407] Connection header received
0808 07:06:14.505470 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:14.505471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:14.505482 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:14.505540 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 07:06:14.505953 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37316: BlockingRecv error: recv got EOF from 127.0.0.1:37316 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 07:06:14.838814 30574 catalog_manager.cc:1259] Loaded cluster ID: a59b9629b62546c7bc0eca307c8a9657
I20260808 07:06:14.838899 30574 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: loading cluster ID for follower catalog manager: success
I20260808 07:06:14.839706 30574 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: acquiring CA information for follower catalog manager: success
I20260808 07:06:14.839974 30574 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6f8c4a94a96845d896f6fe4cb385340e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:06:14.927970 30641 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: acquiring CA information for follower catalog manager: success
I20260808 07:06:14.928299 30641 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aeda6efb5d9a468499ee0eab87276fa1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 07:06:15.021440 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.019059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37324 (local address 127.26.23.189:39325)
0808 07:06:15.019183 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.019186 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.019200 (+ 14us) server_negotiation.cc:407] Connection header received
0808 07:06:15.019277 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.019278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.019329 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.019391 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:15.019509 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.020037 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.020786 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.021003 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.021067 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.021179 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:15.021287 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:15.021343 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:15.021356 (+ 13us) server_negotiation.cc:299] Negotiation successful
0808 07:06:15.021374 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
I20260808 07:06:15.025357 30747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.023117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34750 (local address 127.26.23.188:40769)
0808 07:06:15.023226 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.023228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.023235 (+ 7us) server_negotiation.cc:407] Connection header received
0808 07:06:15.023270 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.023271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.023307 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.023371 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:15.023496 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.023963 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.024707 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.024900 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.024950 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.025041 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:15.025152 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:15.025203 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:15.025256 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 07:06:15.025274 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":50,"threads_started":1}
I20260808 07:06:15.029664 30747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.027204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34766 (local address 127.26.23.188:40769)
0808 07:06:15.027241 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.027243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.027415 (+ 172us) server_negotiation.cc:407] Connection header received
0808 07:06:15.027486 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.027487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.027497 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.027539 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:15.027635 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.028074 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.029013 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.029194 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.029250 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.029430 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:15.029463 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:15.029513 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:15.029563 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 07:06:15.029584 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 07:06:15.030277 30761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.027012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55952 (local address 127.26.23.190:46711)
0808 07:06:15.027142 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.027144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.027234 (+ 90us) server_negotiation.cc:407] Connection header received
0808 07:06:15.027285 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.027286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.027339 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.027418 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:15.027525 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.028301 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.029253 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.029542 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.029749 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.029827 (+ 78us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:15.030066 (+ 239us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:15.030135 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:15.030173 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 07:06:15.030196 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":56,"threads_started":1}
I20260808 07:06:15.030700 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 07:06:15.026985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37338 (local address 127.26.23.189:39325)
0808 07:06:15.027020 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 07:06:15.027022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 07:06:15.027134 (+ 112us) server_negotiation.cc:407] Connection header received
0808 07:06:15.027233 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 07:06:15.027234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 07:06:15.027245 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 07:06:15.027271 (+ 26us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 07:06:15.027552 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.028291 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.029947 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 07:06:15.030230 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 07:06:15.030287 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 07:06:15.030409 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 07:06:15.030442 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 07:06:15.030489 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 07:06:15.030586 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 07:06:15.030629 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 07:06:15.031884 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30213
I20260808 07:06:15.049018 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30336
I20260808 07:06:15.057188 26718 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGJ9A1U/build/release/bin/kudu with pid 30446
2026-08-08T07:06:15Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2931 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5838 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (271708 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST